Apr 18 14:22:50 user devstack@n-api.service[61308]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 18 14:22:50 user devstack@n-api.service[61308]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 18 14:22:50 2023] *** Apr 18 14:22:50 user devstack@n-api.service[61308]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 18 14:22:50 user devstack@n-api.service[61308]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 18 14:22:50 user devstack@n-api.service[61308]: nodename: user Apr 18 14:22:50 user devstack@n-api.service[61308]: machine: x86_64 Apr 18 14:22:50 user devstack@n-api.service[61308]: clock source: unix Apr 18 14:22:50 user devstack@n-api.service[61308]: pcre jit disabled Apr 18 14:22:50 user devstack@n-api.service[61308]: detected number of CPU cores: 12 Apr 18 14:22:50 user devstack@n-api.service[61308]: current working directory: / Apr 18 14:22:50 user devstack@n-api.service[61308]: detected binary path: /usr/bin/uwsgi-core Apr 18 14:22:50 user devstack@n-api.service[61308]: your processes number limit is 63638 Apr 18 14:22:50 user devstack@n-api.service[61308]: your memory page size is 4096 bytes Apr 18 14:22:50 user devstack@n-api.service[61308]: detected max file descriptor number: 2048 Apr 18 14:22:50 user devstack@n-api.service[61308]: lock engine: pthread robust mutexes Apr 18 14:22:50 user devstack@n-api.service[61308]: thunder lock: enabled Apr 18 14:22:50 user devstack@n-api.service[61308]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 18 14:22:50 user devstack@n-api.service[61308]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 18 14:22:50 user devstack@n-api.service[61308]: Python main interpreter initialized at 0x55ce2afae990 Apr 18 14:22:50 user devstack@n-api.service[61308]: python threads support enabled Apr 18 14:22:50 user devstack@n-api.service[61308]: your server socket listen backlog is limited to 100 connections Apr 18 14:22:50 user devstack@n-api.service[61308]: your mercy for graceful operations on workers is 90 seconds Apr 18 14:22:50 user devstack@n-api.service[61308]: mapped 537436 bytes (524 KB) for 3 cores Apr 18 14:22:50 user devstack@n-api.service[61308]: *** Operational MODE: preforking *** Apr 18 14:22:50 user devstack@n-api.service[61308]: *** uWSGI is running in multiple interpreter mode *** Apr 18 14:22:50 user devstack@n-api.service[61308]: spawned uWSGI master process (pid: 61308) Apr 18 14:22:50 user devstack@n-api.service[61308]: spawned uWSGI worker 1 (pid: 61309, cores: 1) Apr 18 14:22:50 user devstack@n-api.service[61308]: spawned uWSGI worker 2 (pid: 61310, cores: 1) Apr 18 14:22:50 user devstack@n-api.service[61308]: spawned uWSGI worker 3 (pid: 61311, cores: 1) Apr 18 14:22:50 user devstack@n-api.service[61308]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 18 14:22:51 user devstack@n-api.service[61310]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 14:22:51 user devstack@n-api.service[61309]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 14:22:51 user devstack@n-api.service[61311]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 14:22:54 user devstack@n-api.service[61310]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 14:22:54 user devstack@n-api.service[61310]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 14:22:54 user devstack@n-api.service[61310]: and ``live_migration_inbound_addr`` respectively. Apr 18 14:22:54 user devstack@n-api.service[61310]: ). Its value may be silently ignored in the future. Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 14:22:54 user devstack@n-api.service[61309]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 14:22:54 user devstack@n-api.service[61309]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 14:22:54 user devstack@n-api.service[61309]: and ``live_migration_inbound_addr`` respectively. Apr 18 14:22:54 user devstack@n-api.service[61309]: ). Its value may be silently ignored in the future. Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 14:22:54 user devstack@n-api.service[61311]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 14:22:54 user devstack@n-api.service[61311]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 14:22:54 user devstack@n-api.service[61311]: and ``live_migration_inbound_addr`` respectively. Apr 18 14:22:54 user devstack@n-api.service[61311]: ). Its value may be silently ignored in the future. Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61310) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61309) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61311) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 14:22:54 user devstack@n-api.service[61310]: INFO dbcounter [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Registered counter for database nova_api Apr 18 14:22:54 user devstack@n-api.service[61309]: INFO dbcounter [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Registered counter for database nova_api Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG oslo_db.sqlalchemy.engines [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61310) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG oslo_db.sqlalchemy.engines [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61309) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writer thread running {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writer thread running {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 14:22:54 user devstack@n-api.service[61311]: INFO dbcounter [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Registered counter for database nova_api Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG nova.context [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),337bb0b3-02d6-4a06-882a-72d8b3d786a4(cell1) {{(pid=61310) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG nova.context [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),337bb0b3-02d6-4a06-882a-72d8b3d786a4(cell1) {{(pid=61309) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:22:54 user devstack@n-api.service[61310]: INFO dbcounter [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Registered counter for database nova_cell0 Apr 18 14:22:54 user devstack@n-api.service[61309]: INFO dbcounter [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Registered counter for database nova_cell0 Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG oslo_db.sqlalchemy.engines [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61311) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 14:22:54 user devstack@n-api.service[61309]: INFO dbcounter [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Registered counter for database nova_cell1 Apr 18 14:22:54 user devstack@n-api.service[61310]: INFO dbcounter [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Registered counter for database nova_cell1 Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writer thread running {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG oslo_db.sqlalchemy.engines [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61309) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 14:22:54 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writer thread running {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG oslo_db.sqlalchemy.engines [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61310) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writer thread running {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 14:22:54 user devstack@n-api.service[61310]: DEBUG oslo_db.sqlalchemy.engines [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61310) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 14:22:54 user devstack@n-api.service[61311]: DEBUG nova.context [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),337bb0b3-02d6-4a06-882a-72d8b3d786a4(cell1) {{(pid=61311) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 14:22:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:22:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:22:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:22:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:22:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:22:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:22:55 user devstack@n-api.service[61311]: INFO dbcounter [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Registered counter for database nova_cell0 Apr 18 14:22:55 user devstack@n-api.service[61311]: INFO dbcounter [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Registered counter for database nova_cell1 Apr 18 14:22:55 user devstack@n-api.service[61311]: DEBUG oslo_db.sqlalchemy.engines [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61311) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 14:22:55 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writer thread running {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 14:22:55 user devstack@n-api.service[61311]: DEBUG oslo_db.sqlalchemy.engines [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61311) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 14:22:55 user devstack@n-api.service[61309]: DEBUG oslo_db.sqlalchemy.engines [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61309) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 14:22:55 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writer thread running {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 14:22:55 user devstack@n-api.service[61309]: INFO dbcounter [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Registered counter for database nova_cell0 Apr 18 14:22:55 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writer thread running {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 14:22:55 user devstack@n-api.service[61309]: DEBUG oslo_db.sqlalchemy.engines [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61309) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 14:22:55 user devstack@n-api.service[61310]: INFO dbcounter [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Registered counter for database nova_cell0 Apr 18 14:22:55 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writer thread running {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 14:22:55 user devstack@n-api.service[61310]: DEBUG oslo_db.sqlalchemy.engines [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61310) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 14:22:55 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writer thread running {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 14:22:55 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writer thread running {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 14:22:55 user devstack@n-api.service[61311]: INFO dbcounter [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Registered counter for database nova_cell0 Apr 18 14:22:55 user devstack@n-api.service[61311]: DEBUG oslo_db.sqlalchemy.engines [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61311) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 14:22:55 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writer thread running {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 14:22:55 user devstack@n-api.service[61309]: WARNING keystonemiddleware.auth_token [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 14:22:55 user devstack@n-api.service[61309]: WARNING keystonemiddleware.auth_token [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 14:22:55 user devstack@n-api.service[61310]: WARNING keystonemiddleware.auth_token [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 14:22:55 user devstack@n-api.service[61310]: WARNING keystonemiddleware.auth_token [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 14:22:55 user devstack@n-api.service[61309]: WARNING keystonemiddleware.auth_token [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 14:22:55 user devstack@n-api.service[61309]: WARNING keystonemiddleware.auth_token [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 14:22:55 user devstack@n-api.service[61309]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ce2afae990 pid: 61309 (default app) Apr 18 14:22:55 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:22:55 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001546 Apr 18 14:22:55 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 18 14:22:55 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:22:55 user devstack@n-api.service[61310]: WARNING keystonemiddleware.auth_token [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 14:22:55 user devstack@n-api.service[61310]: WARNING keystonemiddleware.auth_token [None req-54e1f298-ea34-4cce-b713-052988a6361f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 14:22:55 user devstack@n-api.service[61310]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ce2afae990 pid: 61310 (default app) Apr 18 14:22:55 user devstack@n-api.service[61311]: WARNING keystonemiddleware.auth_token [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 14:22:55 user devstack@n-api.service[61311]: WARNING keystonemiddleware.auth_token [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 14:22:55 user devstack@n-api.service[61311]: WARNING keystonemiddleware.auth_token [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 14:22:55 user devstack@n-api.service[61311]: WARNING keystonemiddleware.auth_token [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 14:22:56 user devstack@n-api.service[61311]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ce2afae990 pid: 61311 (default app) Apr 18 14:25:01 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:01 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-28eacf98-b61a-45ce-bc2a-63008a1d19a8 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001405 Apr 18 14:25:01 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 14:25:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:01 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=3 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:01 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=3 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:01 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=3 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:01 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=3 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:02 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-0e76f0dd-0f25-457b-813c-c95ea5e9fa83 admin admin] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:02 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-0e76f0dd-0f25-457b-813c-c95ea5e9fa83 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.416703 Apr 18 14:25:02 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 14:25:01 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:25:04 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:04 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002194 Apr 18 14:25:04 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 14:25:04 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:04 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=3 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:04 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=3 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:04 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=3 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:04 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:04 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-48e38b1f-14c8-4437-8f50-87008fcb347a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:04 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-48e38b1f-14c8-4437-8f50-87008fcb347a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.348286 Apr 18 14:25:04 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 14:25:04 2023] POST /compute/v2.1/flavors => generated 405 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:25:04 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-9d005ef4-bb76-4c43-bb48-313e117d8c76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:04 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-9d005ef4-bb76-4c43-bb48-313e117d8c76 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044364 Apr 18 14:25:04 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 14:25:04 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:25:06 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:06 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001329 Apr 18 14:25:06 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 14:25:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:06 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-9e1ae502-0f05-4338-9bf5-4341df51e742 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "name": "ds512M", "vcpus": 1, "ram": 512}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:06 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-9e1ae502-0f05-4338-9bf5-4341df51e742 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066981 Apr 18 14:25:06 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 14:25:06 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:25:06 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-4208dc6f-37aa-4516-9d63-0965d4ddf1e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:06 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-4208dc6f-37aa-4516-9d63-0965d4ddf1e1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028860 Apr 18 14:25:06 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 14:25:06 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:25:08 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:08 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001343 Apr 18 14:25:08 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 14:25:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:08 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-157ab976-8b5d-4e9e-b307-e285585c6005 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:08 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-157ab976-8b5d-4e9e-b307-e285585c6005 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065474 Apr 18 14:25:08 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 14:25:08 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:25:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-e1c0321e-3ae4-470d-87c7-b85fb5d51543 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:08 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-e1c0321e-3ae4-470d-87c7-b85fb5d51543 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026494 Apr 18 14:25:08 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 14:25:08 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:25:10 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:10 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001362 Apr 18 14:25:10 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 14:25:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:10 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-3fbe9a1b-c5ff-41bb-bb5e-989111e7cd6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "ram": 2048}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:10 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-3fbe9a1b-c5ff-41bb-bb5e-989111e7cd6c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061810 Apr 18 14:25:10 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 14:25:10 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:25:10 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-1ed83e43-5a17-439b-b57c-74a6a4539561 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:10 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-1ed83e43-5a17-439b-b57c-74a6a4539561 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025074 Apr 18 14:25:10 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 14:25:10 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:25:12 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:12 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001335 Apr 18 14:25:12 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 14:25:12 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:12 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-a182b968-9584-4191-a036-e0f6c8786d6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "vcpus": 4}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:12 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-a182b968-9584-4191-a036-e0f6c8786d6f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063149 Apr 18 14:25:12 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 14:25:12 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:25:12 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:12 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024127 Apr 18 14:25:12 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 14:25:12 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:25:14 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:14 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ca0f8b5e-2ff2-44b2-82fe-af616a942d22 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001444 Apr 18 14:25:14 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 14:25:14 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:14 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-78b7b1bb-1d0c-4e2d-9c56-12962ed28ee4 admin admin] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:14 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-78b7b1bb-1d0c-4e2d-9c56-12962ed28ee4 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.073939 Apr 18 14:25:14 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 14:25:14 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:25:16 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:16 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001492 Apr 18 14:25:16 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 14:25:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:16 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=3 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:16 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=3 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:16 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=3 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:16 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=3 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:16 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-2d0b7dbc-3db6-4b13-956c-9c9bfcae1781 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "ram": 512, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:16 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-2d0b7dbc-3db6-4b13-956c-9c9bfcae1781 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.307478 Apr 18 14:25:16 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 14:25:16 2023] POST /compute/v2.1/flavors => generated 400 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:25:16 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-fc475549-0956-4146-b04a-6024abb68cb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:16 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-fc475549-0956-4146-b04a-6024abb68cb8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040203 Apr 18 14:25:16 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 14:25:16 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:25:18 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:18 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001349 Apr 18 14:25:18 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 14:25:18 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:18 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-3db23da7-8c5b-4f93-840d-5940f30fb456 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:18 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-3db23da7-8c5b-4f93-840d-5940f30fb456 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.063113 Apr 18 14:25:18 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 14:25:18 2023] POST /compute/v2.1/flavors => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:25:18 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-8f12e898-4cbc-40c3-8b0e-3b44eb5ec849 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:18 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-8f12e898-4cbc-40c3-8b0e-3b44eb5ec849 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030776 Apr 18 14:25:18 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 14:25:18 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:25:20 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:20 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001366 Apr 18 14:25:20 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 14:25:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:20 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ced3b270-8df4-4297-a403-438f683c86c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "name": "m1.medium", "disk": 40, "id": "3", "os-flavor-access:is_public": true}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:20 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ced3b270-8df4-4297-a403-438f683c86c5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063999 Apr 18 14:25:20 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 14:25:20 2023] POST /compute/v2.1/flavors => generated 404 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:25:20 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-360c6aa0-b96c-4f1f-bc74-ad2c96fe7a5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:20 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-360c6aa0-b96c-4f1f-bc74-ad2c96fe7a5a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038915 Apr 18 14:25:20 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 14:25:20 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:25:22 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:22 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001313 Apr 18 14:25:22 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 14:25:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:22 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-434254b7-02f6-4658-9410-fb50c1211685 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large"}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:22 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-434254b7-02f6-4658-9410-fb50c1211685 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064050 Apr 18 14:25:22 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 14:25:22 2023] POST /compute/v2.1/flavors => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:25:22 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-1c888051-7c05-4d41-8194-6de970feeed7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:22 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-1c888051-7c05-4d41-8194-6de970feeed7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026224 Apr 18 14:25:22 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 14:25:22 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:25:24 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:24 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001495 Apr 18 14:25:24 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 14:25:24 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:24 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-51b38336-80d3-4811-bee9-5857db83a038 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "id": "5", "ram": 16384}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:24 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-51b38336-80d3-4811-bee9-5857db83a038 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.065246 Apr 18 14:25:24 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 14:25:24 2023] POST /compute/v2.1/flavors => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:25:24 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-90628dca-c7c2-4a2b-8336-2c4c3c1333de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:25:24 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-90628dca-c7c2-4a2b-8336-2c4c3c1333de admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024098 Apr 18 14:25:24 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 14:25:24 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:25:56 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:56 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-4edc5521-d9e8-4de5-a61c-4f6453f05558 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001416 Apr 18 14:25:56 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 14:25:56 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:25:56 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:25:56 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-13468f34-9518-4292-9e1b-f62310cfc747 admin admin] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:25:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-13468f34-9518-4292-9e1b-f62310cfc747 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:25:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-13468f34-9518-4292-9e1b-f62310cfc747 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:25:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-13468f34-9518-4292-9e1b-f62310cfc747 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:25:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-13468f34-9518-4292-9e1b-f62310cfc747 admin admin] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:25:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-13468f34-9518-4292-9e1b-f62310cfc747 admin admin] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:25:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-13468f34-9518-4292-9e1b-f62310cfc747 admin admin] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:25:56 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-13468f34-9518-4292-9e1b-f62310cfc747 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.086834 Apr 18 14:25:56 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 18 14:25:56 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:26:28 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-90628dca-c7c2-4a2b-8336-2c4c3c1333de admin admin] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:26:28 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-90628dca-c7c2-4a2b-8336-2c4c3c1333de admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002650 Apr 18 14:26:28 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 14:26:28 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:26:28 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:26:28 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-bfe537c3-aa4f-44ed-b32d-987eea8a9120 admin admin] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:26:28 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-bfe537c3-aa4f-44ed-b32d-987eea8a9120 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.067159 Apr 18 14:26:28 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 18 14:26:28 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:26:32 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-13468f34-9518-4292-9e1b-f62310cfc747 admin admin] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:26:32 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-13468f34-9518-4292-9e1b-f62310cfc747 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001401 Apr 18 14:26:32 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 14:26:32 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:26:32 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:26:32 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-96e06e59-656e-4611-a51e-b5478152a785 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 128, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "name": "m1.nano", "vcpus": 1, "id": "42"}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:26:32 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-96e06e59-656e-4611-a51e-b5478152a785 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.067284 Apr 18 14:26:32 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 14:26:32 2023] POST /compute/v2.1/flavors => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:26:32 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-8bfaa6a5-ec61-4301-a294-b264b8ffe923 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:26:32 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-8bfaa6a5-ec61-4301-a294-b264b8ffe923 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030707 Apr 18 14:26:32 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 14:26:32 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:26:36 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-13468f34-9518-4292-9e1b-f62310cfc747 admin admin] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:26:36 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-13468f34-9518-4292-9e1b-f62310cfc747 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001633 Apr 18 14:26:36 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 14:26:36 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:26:36 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-0320e57f-6b32-4608-9316-a5c4d0676f85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "84", "ram": 192, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.micro", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:26:36 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-0320e57f-6b32-4608-9316-a5c4d0676f85 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063050 Apr 18 14:26:36 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 14:26:36 2023] POST /compute/v2.1/flavors => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:26:36 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-f90214c5-b79b-491d-9ca8-d13bf27c3f78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:26:36 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-f90214c5-b79b-491d-9ca8-d13bf27c3f78 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027449 Apr 18 14:26:36 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 14:26:36 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:28:48 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:28:48 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:28:48 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:28:49 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:28:49 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ae1639b1-0d41-4189-90f8-a9de48fad43b tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] Action: 'create', calling method: .version_select at 0x7f5cef681360>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-857823276"}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:28:49 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-c25c2d5e-14f9-4d6e-a308-77ce3c9edb00 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] Action: 'create', calling method: .version_select at 0x7f5cef680c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1362178208", "metadata": {"Type": "work"}}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:28:50 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ae1639b1-0d41-4189-90f8-a9de48fad43b tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.422484 Apr 18 14:28:50 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 18 14:28:48 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 1425 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 14:28:50 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:28:50 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-9444dca2-d912-45b0-abeb-20ad2ab290de tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] Calling method '.version_select at 0x7f5cef65ec20>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:28:50 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-9444dca2-d912-45b0-abeb-20ad2ab290de tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7becda43-83ec-4b8d-9b40-f9165c3eaffc" status: 200 len: 341 microversion: 2.1 time: 0.238380 Apr 18 14:28:50 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 16/47] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 14:28:50 2023] GET /compute/v2.1/os-volumes/7becda43-83ec-4b8d-9b40-f9165c3eaffc => generated 341 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:28:50 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-c25c2d5e-14f9-4d6e-a308-77ce3c9edb00 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.752655 Apr 18 14:28:50 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 17/48] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 14:28:49 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 1754 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 14:28:50 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-d77af411-1406-4506-a071-562258639a45 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] Calling method '.version_select at 0x7f5cef50c430>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:28:51 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-d77af411-1406-4506-a071-562258639a45 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7677917d-29d7-48d9-bf67-f99067e6523e" status: 200 len: 353 microversion: 2.1 time: 0.309396 Apr 18 14:28:51 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 14:28:50 2023] GET /compute/v2.1/os-volumes/7677917d-29d7-48d9-bf67-f99067e6523e => generated 353 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:28:51 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-7226db06-e753-4c7f-aa5b-1fe5670e074e tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] Calling method '.version_select at 0x7f5cef6fab90>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:28:51 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-7226db06-e753-4c7f-aa5b-1fe5670e074e tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7becda43-83ec-4b8d-9b40-f9165c3eaffc" status: 200 len: 341 microversion: 2.1 time: 0.062931 Apr 18 14:28:51 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 14:28:51 2023] GET /compute/v2.1/os-volumes/7becda43-83ec-4b8d-9b40-f9165c3eaffc => generated 341 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:28:51 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-328365a7-3078-4652-873b-52713c856632 tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] Calling method '.version_select at 0x7f5cef503880>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:28:51 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-328365a7-3078-4652-873b-52713c856632 tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/7becda43-83ec-4b8d-9b40-f9165c3eaffc" status: 202 len: 0 microversion: 2.1 time: 0.119122 Apr 18 14:28:51 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 18/51] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 14:28:51 2023] DELETE /compute/v2.1/os-volumes/7becda43-83ec-4b8d-9b40-f9165c3eaffc => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:28:51 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ec637f0b-f111-4362-953d-750ee5f0bd51 tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] Calling method '.version_select at 0x7f5cef50c5e0>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:28:51 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-ec637f0b-f111-4362-953d-750ee5f0bd51 tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] HTTP exception thrown: Volume 7becda43-83ec-4b8d-9b40-f9165c3eaffc could not be found. Apr 18 14:28:51 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ec637f0b-f111-4362-953d-750ee5f0bd51 tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] Request method failure captured: Apr 18 14:28:51 user devstack@n-api.service[61311]: request: GET /compute/v2.1/os-volumes/7becda43-83ec-4b8d-9b40-f9165c3eaffc HTTP/1.1 Apr 18 14:28:51 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:28:51 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:28:51 user devstack@n-api.service[61311]: Connection: close Apr 18 14:28:51 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:28:51 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:28:51 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:28:51 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:28:51 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqkgjmju3QHcVcN9w1xbFDMFoPC0rEcwQvHrVNogTOlubnJLwy_-YRRgWFvrelkszIayPw_UYx6hXS8Mnu9pX1wjmIb9h6yGqMTrazqCoOZd2ZQSoXAr4SeweN6kEk81Q8Zl_Hgl3n_y1Lp-45SaWxuysnuuOFbJVRKVB_D4jNDTj18 Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Project-Id: 3b9cf74f9e2a463a839298440ce9ae4d Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1002321617 Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b9cf74f9e2a463a839298440ce9ae4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b9cf74f9e2a463a839298440ce9ae4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b9cf74f9e2a463a839298440ce9ae4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1002321617 Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Tenant-Id: 3b9cf74f9e2a463a839298440ce9ae4d Apr 18 14:28:51 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1002321617 Apr 18 14:28:51 user devstack@n-api.service[61311]: X-User: tempest-VolumesSnapshotsTestJSON-1002321617-project-member Apr 18 14:28:51 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:28:51 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:28:51 user devstack@n-api.service[61311]: X-User-Id: 2c4191e937cc460caaed70373af185a6 Apr 18 14:28:51 user devstack@n-api.service[61311]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1002321617-project-member Apr 18 14:28:51 user devstack@n-api.service[61311]: method: Apr 18 14:28:51 user devstack@n-api.service[61311]: exception: Volume 7becda43-83ec-4b8d-9b40-f9165c3eaffc could not be found. Apr 18 14:28:51 user devstack@n-api.service[61311]: action_args: {'id': '7becda43-83ec-4b8d-9b40-f9165c3eaffc'} Apr 18 14:28:51 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7becda43-83ec-4b8d-9b40-f9165c3eaffc could not be found. (HTTP 404) (Request-ID: req-17d70b60-e9ad-4924-b617-c4e292e80ac2) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7becda43-83ec-4b8d-9b40-f9165c3eaffc could not be found. Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7becda43-83ec-4b8d-9b40-f9165c3eaffc could not be found. Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7becda43-83ec-4b8d-9b40-f9165c3eaffc could not be found. Apr 18 14:28:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:51 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ec637f0b-f111-4362-953d-750ee5f0bd51 tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] Returning 404 to user: Volume 7becda43-83ec-4b8d-9b40-f9165c3eaffc could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:28:51 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ec637f0b-f111-4362-953d-750ee5f0bd51 tempest-VolumesSnapshotsTestJSON-1002321617 tempest-VolumesSnapshotsTestJSON-1002321617-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7becda43-83ec-4b8d-9b40-f9165c3eaffc" status: 404 len: 109 microversion: 2.1 time: 0.040939 Apr 18 14:28:51 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 14:28:51 2023] GET /compute/v2.1/os-volumes/7becda43-83ec-4b8d-9b40-f9165c3eaffc => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:28:52 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-cccb9f11-0007-4f46-903d-888caaa6ef14 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] Calling method '.version_select at 0x7f5cef6fb250>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:28:52 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-cccb9f11-0007-4f46-903d-888caaa6ef14 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7677917d-29d7-48d9-bf67-f99067e6523e" status: 200 len: 350 microversion: 2.1 time: 0.056927 Apr 18 14:28:52 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 18/53] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 14:28:52 2023] GET /compute/v2.1/os-volumes/7677917d-29d7-48d9-bf67-f99067e6523e => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:28:52 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-c9b44745-cd34-4881-a3e7-5b43a9f43464 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] Calling method '.version_select at 0x7f5cef503f40>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:28:52 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-c9b44745-cd34-4881-a3e7-5b43a9f43464 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/7677917d-29d7-48d9-bf67-f99067e6523e" status: 202 len: 0 microversion: 2.1 time: 0.113905 Apr 18 14:28:52 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 19/54] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 14:28:52 2023] DELETE /compute/v2.1/os-volumes/7677917d-29d7-48d9-bf67-f99067e6523e => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:28:52 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-1c21ce98-d4c7-4060-86d9-feff42c1c9b3 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] Calling method '.version_select at 0x7f5cf00952d0>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:28:52 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-1c21ce98-d4c7-4060-86d9-feff42c1c9b3 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] HTTP exception thrown: Volume 7677917d-29d7-48d9-bf67-f99067e6523e could not be found. Apr 18 14:28:52 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-1c21ce98-d4c7-4060-86d9-feff42c1c9b3 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] Request method failure captured: Apr 18 14:28:52 user devstack@n-api.service[61311]: request: GET /compute/v2.1/os-volumes/7677917d-29d7-48d9-bf67-f99067e6523e HTTP/1.1 Apr 18 14:28:52 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:28:52 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:28:52 user devstack@n-api.service[61311]: Connection: close Apr 18 14:28:52 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:28:52 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:28:52 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:28:52 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:28:52 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqkgasHkGYl8sCxThOBb7fI9uOH9Dx96ua3E0x1VybMAuXcKNaB1x1Uz0CGdOk2MUyoZJAplBjzgEBRRwEG7Rrwz8ZLoqtW3WTFGHrkNpR0J7cj0lcpKSJovjoYK6rXy_x-yMo5YN45W_LBHfzVQE-6jdbbd8iQptrGX7WOIZcdxBkk Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Project-Id: 15bfb5955e3445cfaedecaf8d76a6252 Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Project-Name: tempest-VolumesGetTestJSON-1466412329 Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15bfb5955e3445cfaedecaf8d76a6252"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/15bfb5955e3445cfaedecaf8d76a6252"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15bfb5955e3445cfaedecaf8d76a6252"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Tenant: tempest-VolumesGetTestJSON-1466412329 Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Tenant-Id: 15bfb5955e3445cfaedecaf8d76a6252 Apr 18 14:28:52 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-VolumesGetTestJSON-1466412329 Apr 18 14:28:52 user devstack@n-api.service[61311]: X-User: tempest-VolumesGetTestJSON-1466412329-project-member Apr 18 14:28:52 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:28:52 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:28:52 user devstack@n-api.service[61311]: X-User-Id: 6e77dcca76454632ac0a8ca48a0439e1 Apr 18 14:28:52 user devstack@n-api.service[61311]: X-User-Name: tempest-VolumesGetTestJSON-1466412329-project-member Apr 18 14:28:52 user devstack@n-api.service[61311]: method: Apr 18 14:28:52 user devstack@n-api.service[61311]: exception: Volume 7677917d-29d7-48d9-bf67-f99067e6523e could not be found. Apr 18 14:28:52 user devstack@n-api.service[61311]: action_args: {'id': '7677917d-29d7-48d9-bf67-f99067e6523e'} Apr 18 14:28:52 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7677917d-29d7-48d9-bf67-f99067e6523e could not be found. (HTTP 404) (Request-ID: req-f70c24b1-ab51-4af3-b101-84cba0980433) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7677917d-29d7-48d9-bf67-f99067e6523e could not be found. Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7677917d-29d7-48d9-bf67-f99067e6523e could not be found. Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7677917d-29d7-48d9-bf67-f99067e6523e could not be found. Apr 18 14:28:52 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:28:52 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-1c21ce98-d4c7-4060-86d9-feff42c1c9b3 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] Returning 404 to user: Volume 7677917d-29d7-48d9-bf67-f99067e6523e could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:28:52 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-1c21ce98-d4c7-4060-86d9-feff42c1c9b3 tempest-VolumesGetTestJSON-1466412329 tempest-VolumesGetTestJSON-1466412329-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7677917d-29d7-48d9-bf67-f99067e6523e" status: 404 len: 109 microversion: 2.1 time: 0.038404 Apr 18 14:28:52 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 14:28:52 2023] GET /compute/v2.1/os-volumes/7677917d-29d7-48d9-bf67-f99067e6523e => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:29:04 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1074427413", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:04 user devstack@n-api.service[61310]: DEBUG nova.network.neutron [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] validate_networks() for [('40233280-87ff-4413-9292-88b81911f573', None, None, None, None, None)] {{(pid=61310) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Flavor limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Image limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Flavor pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Image pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Getting quotas for project e4ca11d8beec4410a8a4c8ae7c8e4bed. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Getting quotas for user 7e284b794c4043768af56fd58fceb837 and project e4ca11d8beec4410a8a4c8ae7c8e4bed. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Going to run 1 instances... {{(pid=61310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:29:06 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 1b067df0-2ea8-44e6-9418-98788edf4e7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:29:06 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-65f937b3-ce4f-49ba-a21b-8630661360d4 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.505714 Apr 18 14:29:06 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 19/56] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:29:04 2023] POST /compute/v2.1/servers => generated 381 bytes in 2507 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:29:06 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-137494a9-c0a5-4cba-a4a4-a1891ed60e8d tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:29:06 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-137494a9-c0a5-4cba-a4a4-a1891ed60e8d tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 1b067df0-2ea8-44e6-9418-98788edf4e7d] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:29:06 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-137494a9-c0a5-4cba-a4a4-a1891ed60e8d tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e284b794c4043768af56fd58fceb837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ca11d8beec4410a8a4c8ae7c8e4bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:29:07 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-137494a9-c0a5-4cba-a4a4-a1891ed60e8d tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b067df0-2ea8-44e6-9418-98788edf4e7d" status: 200 len: 1216 microversion: 2.1 time: 0.221493 Apr 18 14:29:07 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 20/57] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:29:06 2023] GET /compute/v2.1/servers/1b067df0-2ea8-44e6-9418-98788edf4e7d => generated 1216 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:29:07 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-789779953", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:07 user devstack@n-api.service[61311]: DEBUG nova.network.neutron [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] validate_networks() for [('40233280-87ff-4413-9292-88b81911f573', None, None, None, None, None)] {{(pid=61311) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:29:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-8ab3cf25-32e5-4b4c-abad-4a3babf856f3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Action: 'create', calling method: .version_select at 0x7f5cef5cce50>, body: {"keypair": {"name": "tempest-keypair-791769318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc3QPBXQ4nVx2JCRWrT6JCIt2SgbFlb+QMEXEnEKTjVVtZBfYfS8KCkAaHpbD2VfvLXrZ4CG2ft+VpkRcBGVlwqPbUWTJg9Sp/HKQP21J43CDOfCL4ajx/wVQ2XVgQM7A=="}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:08 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-8ab3cf25-32e5-4b4c-abad-4a3babf856f3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Getting quotas for project 88dd648f400c48f384c828c3933baa5a. Resources: {'key_pairs'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:29:08 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-8ab3cf25-32e5-4b4c-abad-4a3babf856f3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Getting quotas for user 36b9b392cafe4b58b429be8e010baa08 and project 88dd648f400c48f384c828c3933baa5a. Resources: {'key_pairs'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:29:08 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-8ab3cf25-32e5-4b4c-abad-4a3babf856f3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124423 Apr 18 14:29:08 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 20/58] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:29:08 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:08 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-736255234", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "networks": [{"uuid": "7de7c9c8-6753-4201-a6c7-ffa00da6c3ee"}]}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:08 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] validate_networks() for [('7de7c9c8-6753-4201-a6c7-ffa00da6c3ee', None, None, None, None, None)] {{(pid=61309) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:29:10 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Flavor limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:29:10 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Image limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:29:10 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Flavor pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:29:10 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Image pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:29:10 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:29:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:11 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Getting quotas for project e4ca11d8beec4410a8a4c8ae7c8e4bed. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:29:11 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Getting quotas for user 7e284b794c4043768af56fd58fceb837 and project e4ca11d8beec4410a8a4c8ae7c8e4bed. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:29:11 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Going to run 1 instances... {{(pid=61311) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:29:11 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 909db006-c38d-4b50-acaa-4224aed6ea45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:29:11 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-aa0c8cd7-8f9c-41d3-811a-1f1efd884ea9 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 3.961806 Apr 18 14:29:11 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 19/59] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:29:07 2023] POST /compute/v2.1/servers => generated 381 bytes in 3963 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:29:11 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-936ce342-3b27-4e1d-959e-59f3340b4e54 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:29:11 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-936ce342-3b27-4e1d-959e-59f3340b4e54 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 909db006-c38d-4b50-acaa-4224aed6ea45] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:29:11 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-936ce342-3b27-4e1d-959e-59f3340b4e54 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e284b794c4043768af56fd58fceb837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ca11d8beec4410a8a4c8ae7c8e4bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:29:11 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-936ce342-3b27-4e1d-959e-59f3340b4e54 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45" status: 200 len: 1215 microversion: 2.1 time: 0.142174 Apr 18 14:29:11 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 21/60] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:29:11 2023] GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:29:12 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-66c43875-d971-4c8a-88be-649595f34869 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Action: 'create', calling method: .version_select at 0x7f5cef448310>, body: {"keypair": {"name": "tempest-keypair-962705370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpLS7abpM/EQgVdSDy+gJ6NGYbnPN85cxrtlMsB6zEzxqjqIHAyNdNVcfvxWGfUPKRBnPGbLLZLXKZFiL9l2RtILBDOhGyhMZkyKNxBhZfp4xjE17mHNG7lrfvwNy9Vhg=="}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Flavor limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Image limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Flavor pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Image pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:29:12 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-66c43875-d971-4c8a-88be-649595f34869 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Getting quotas for project 279c1fea5cfc423b94ca756ebafb2515. Resources: {'key_pairs'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:29:12 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-66c43875-d971-4c8a-88be-649595f34869 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Getting quotas for user 614f7a3a8f3348df9d81f693e733905b and project 279c1fea5cfc423b94ca756ebafb2515. Resources: {'key_pairs'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:12 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-66c43875-d971-4c8a-88be-649595f34869 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.302198 Apr 18 14:29:12 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 20/61] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:29:12 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Getting quotas for project 3312c2b6e41142799cb66dd1377558d8. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Getting quotas for user b209357fca7f40c0b52507a285e054e3 and project 3312c2b6e41142799cb66dd1377558d8. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Going to run 1 instances... {{(pid=61309) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:29:12 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: e5323297-c840-4fd6-9a76-727ed36de870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61309) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:29:12 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-43af542b-4d01-46eb-bdaa-a4fae815bbc2 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.673317 Apr 18 14:29:12 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 21/62] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:29:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 3675 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:29:12 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-02835ba5-51b3-4398-9a63-965a84de6ffa tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:29:12 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-02835ba5-51b3-4398-9a63-965a84de6ffa tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: e5323297-c840-4fd6-9a76-727ed36de870] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:29:12 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-02835ba5-51b3-4398-9a63-965a84de6ffa tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b209357fca7f40c0b52507a285e054e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312c2b6e41142799cb66dd1377558d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:29:12 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-02835ba5-51b3-4398-9a63-965a84de6ffa tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870" status: 200 len: 1210 microversion: 2.1 time: 0.100330 Apr 18 14:29:12 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 22/63] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:29:12 2023] GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:29:14 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1758402667", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d3e19e74-bda1-4d28-b7e4-e98675072612"}], "security_groups": [{"name": "tempest-securitygroup--743095294"}], "key_name": "tempest-keypair-791769318", "user_data": "}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:15 user devstack@n-api.service[61311]: DEBUG nova.network.neutron [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] validate_networks() for [('d3e19e74-bda1-4d28-b7e4-e98675072612', None, None, None, None, None)] {{(pid=61311) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-f6766d45-af86-4f65-938d-92bda22f0dbb req-a10e05dc-80b3-4a0d-96dc-8f8a8ebfa142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b067df0-2ea8-44e6-9418-98788edf4e7d", "tag": "1887cbf2-46d7-4b36-b8a4-83012bf1cb9f"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-f6766d45-af86-4f65-938d-92bda22f0dbb req-a10e05dc-80b3-4a0d-96dc-8f8a8ebfa142 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-f6766d45-af86-4f65-938d-92bda22f0dbb req-a10e05dc-80b3-4a0d-96dc-8f8a8ebfa142 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-f6766d45-af86-4f65-938d-92bda22f0dbb req-a10e05dc-80b3-4a0d-96dc-8f8a8ebfa142 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:16 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-f6766d45-af86-4f65-938d-92bda22f0dbb req-a10e05dc-80b3-4a0d-96dc-8f8a8ebfa142 service nova] Creating event network-changed:1887cbf2-46d7-4b36-b8a4-83012bf1cb9f for instance 1b067df0-2ea8-44e6-9418-98788edf4e7d on user Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-f6766d45-af86-4f65-938d-92bda22f0dbb req-a10e05dc-80b3-4a0d-96dc-8f8a8ebfa142 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61309) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-f6766d45-af86-4f65-938d-92bda22f0dbb req-a10e05dc-80b3-4a0d-96dc-8f8a8ebfa142 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61309) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f0ed7025-2944-4561-a92c-dd149225e6d6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f0ed7025-2944-4561-a92c-dd149225e6d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f0ed7025-2944-4561-a92c-dd149225e6d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f0ed7025-2944-4561-a92c-dd149225e6d6 None None] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f0ed7025-2944-4561-a92c-dd149225e6d6 None None] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f0ed7025-2944-4561-a92c-dd149225e6d6 None None] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:16 user devstack@n-api.service[61309]: INFO nova.compute.rpcapi [None req-f0ed7025-2944-4561-a92c-dd149225e6d6 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 14:29:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f0ed7025-2944-4561-a92c-dd149225e6d6 None None] Releasing lock "compute-rpcapi-router" {{(pid=61309) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 14:29:16 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-f0ed7025-2944-4561-a92c-dd149225e6d6 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182246 Apr 18 14:29:16 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 22/64] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Flavor limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Image limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Flavor pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Image pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Getting quotas for project 88dd648f400c48f384c828c3933baa5a. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Getting quotas for user 36b9b392cafe4b58b429be8e010baa08 and project 88dd648f400c48f384c828c3933baa5a. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Going to run 1 instances... {{(pid=61311) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:29:17 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 6dcffb71-055a-4ae6-bf65-df885c035e5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:29:17 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-7451cfe0-7074-4a00-aedc-565daa7e94ab tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 2.637779 Apr 18 14:29:17 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 21/65] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:29:14 2023] POST /compute/v2.1/servers => generated 399 bytes in 2640 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:29:17 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-056c924b-72c6-423e-8637-9b576f444e25 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:29:17 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-056c924b-72c6-423e-8637-9b576f444e25 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 6dcffb71-055a-4ae6-bf65-df885c035e5a] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:29:17 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:17 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:17 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-056c924b-72c6-423e-8637-9b576f444e25 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b9b392cafe4b58b429be8e010baa08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88dd648f400c48f384c828c3933baa5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:29:17 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-056c924b-72c6-423e-8637-9b576f444e25 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a" status: 200 len: 1231 microversion: 2.1 time: 0.340851 Apr 18 14:29:17 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 23/66] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:29:17 2023] GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a => generated 1231 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:29:20 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-927544894", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "39d43ad2-26f1-4ec3-9bdc-0978776b01d2"}], "security_groups": [{"name": "tempest-securitygroup--1576115659"}], "key_name": "tempest-keypair-962705370", "user_data": "}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-77a2f33b-af8e-465c-a3b9-0168c7956df0 req-c786a99c-ae5b-4b17-bf4e-adb96e9cf173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "909db006-c38d-4b50-acaa-4224aed6ea45", "tag": "f4b085c8-1069-40a4-8d8b-ebb5633472a6"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-77a2f33b-af8e-465c-a3b9-0168c7956df0 req-c786a99c-ae5b-4b17-bf4e-adb96e9cf173 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-77a2f33b-af8e-465c-a3b9-0168c7956df0 req-c786a99c-ae5b-4b17-bf4e-adb96e9cf173 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-77a2f33b-af8e-465c-a3b9-0168c7956df0 req-c786a99c-ae5b-4b17-bf4e-adb96e9cf173 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:20 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] validate_networks() for [('39d43ad2-26f1-4ec3-9bdc-0978776b01d2', None, None, None, None, None)] {{(pid=61309) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:29:20 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-77a2f33b-af8e-465c-a3b9-0168c7956df0 req-c786a99c-ae5b-4b17-bf4e-adb96e9cf173 service nova] Creating event network-changed:f4b085c8-1069-40a4-8d8b-ebb5633472a6 for instance 909db006-c38d-4b50-acaa-4224aed6ea45 on user Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-77a2f33b-af8e-465c-a3b9-0168c7956df0 req-c786a99c-ae5b-4b17-bf4e-adb96e9cf173 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61311) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-77a2f33b-af8e-465c-a3b9-0168c7956df0 req-c786a99c-ae5b-4b17-bf4e-adb96e9cf173 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61311) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e6917be1-8f9c-4de6-a067-af70325f5866 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e6917be1-8f9c-4de6-a067-af70325f5866 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e6917be1-8f9c-4de6-a067-af70325f5866 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e6917be1-8f9c-4de6-a067-af70325f5866 None None] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e6917be1-8f9c-4de6-a067-af70325f5866 None None] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e6917be1-8f9c-4de6-a067-af70325f5866 None None] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:20 user devstack@n-api.service[61311]: INFO nova.compute.rpcapi [None req-e6917be1-8f9c-4de6-a067-af70325f5866 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 14:29:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e6917be1-8f9c-4de6-a067-af70325f5866 None None] Releasing lock "compute-rpcapi-router" {{(pid=61311) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 14:29:20 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-e6917be1-8f9c-4de6-a067-af70325f5866 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152649 Apr 18 14:29:20 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 22/67] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-934940bf-f756-4fc5-addc-066ebd333f43 req-ed1fbd2e-3e6e-446b-8d76-c2b3323748ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5323297-c840-4fd6-9a76-727ed36de870", "tag": "1c41c5ca-21a5-4ea1-9a38-7c78341ea267"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-934940bf-f756-4fc5-addc-066ebd333f43 req-ed1fbd2e-3e6e-446b-8d76-c2b3323748ed service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-934940bf-f756-4fc5-addc-066ebd333f43 req-ed1fbd2e-3e6e-446b-8d76-c2b3323748ed service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-934940bf-f756-4fc5-addc-066ebd333f43 req-ed1fbd2e-3e6e-446b-8d76-c2b3323748ed service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:22 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=8 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:22 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-934940bf-f756-4fc5-addc-066ebd333f43 req-ed1fbd2e-3e6e-446b-8d76-c2b3323748ed service nova] Creating event network-changed:1c41c5ca-21a5-4ea1-9a38-7c78341ea267 for instance e5323297-c840-4fd6-9a76-727ed36de870 on user Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-934940bf-f756-4fc5-addc-066ebd333f43 req-ed1fbd2e-3e6e-446b-8d76-c2b3323748ed service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61310) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-934940bf-f756-4fc5-addc-066ebd333f43 req-ed1fbd2e-3e6e-446b-8d76-c2b3323748ed service nova] Acquired lock "compute-rpcapi-router" {{(pid=61310) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-de430a13-127c-438b-805d-ae5956bf436e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-de430a13-127c-438b-805d-ae5956bf436e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-de430a13-127c-438b-805d-ae5956bf436e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-de430a13-127c-438b-805d-ae5956bf436e None None] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-de430a13-127c-438b-805d-ae5956bf436e None None] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-de430a13-127c-438b-805d-ae5956bf436e None None] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:22 user devstack@n-api.service[61310]: INFO nova.compute.rpcapi [None req-de430a13-127c-438b-805d-ae5956bf436e None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 14:29:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-de430a13-127c-438b-805d-ae5956bf436e None None] Releasing lock "compute-rpcapi-router" {{(pid=61310) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 14:29:22 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-de430a13-127c-438b-805d-ae5956bf436e None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077316 Apr 18 14:29:22 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 24/68] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Flavor limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Image limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Flavor pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Image pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Getting quotas for project 279c1fea5cfc423b94ca756ebafb2515. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Getting quotas for user 614f7a3a8f3348df9d81f693e733905b and project 279c1fea5cfc423b94ca756ebafb2515. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Going to run 1 instances... {{(pid=61309) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:29:23 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61309) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:29:23 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-2641cfbe-3f5d-4533-a020-8aaad102b7f4 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.970328 Apr 18 14:29:23 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 23/69] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:29:20 2023] POST /compute/v2.1/servers => generated 407 bytes in 2973 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:29:23 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-589a7648-4fae-4681-8156-cc20890dcc06 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:29:23 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-589a7648-4fae-4681-8156-cc20890dcc06 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:29:23 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-589a7648-4fae-4681-8156-cc20890dcc06 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:29:23 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-589a7648-4fae-4681-8156-cc20890dcc06 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1231 microversion: 2.1 time: 0.197730 Apr 18 14:29:23 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 25/70] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:29:23 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1231 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:29:23 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-a47b25dc-67a1-4c69-b61b-0e152b8b86d0 req-aea5a86b-a44e-4026-84ff-abf533d45222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dcffb71-055a-4ae6-bf65-df885c035e5a", "tag": "598909ff-6d80-4f39-91d5-a53ca08f248d"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:23 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-a47b25dc-67a1-4c69-b61b-0e152b8b86d0 req-aea5a86b-a44e-4026-84ff-abf533d45222 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:23 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-a47b25dc-67a1-4c69-b61b-0e152b8b86d0 req-aea5a86b-a44e-4026-84ff-abf533d45222 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:23 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-a47b25dc-67a1-4c69-b61b-0e152b8b86d0 req-aea5a86b-a44e-4026-84ff-abf533d45222 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:23 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-a47b25dc-67a1-4c69-b61b-0e152b8b86d0 req-aea5a86b-a44e-4026-84ff-abf533d45222 service nova] Creating event network-changed:598909ff-6d80-4f39-91d5-a53ca08f248d for instance 6dcffb71-055a-4ae6-bf65-df885c035e5a on user Apr 18 14:29:23 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-a47b25dc-67a1-4c69-b61b-0e152b8b86d0 req-aea5a86b-a44e-4026-84ff-abf533d45222 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.312154 Apr 18 14:29:23 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 23/71] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:25 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-a3ba72dc-8eb6-4361-bd76-b2882ca001d3 req-82376c82-c922-41ea-82ad-f719fab6c424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b067df0-2ea8-44e6-9418-98788edf4e7d", "name": "network-vif-plugged", "status": "completed", "tag": "1887cbf2-46d7-4b36-b8a4-83012bf1cb9f"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:25 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-a3ba72dc-8eb6-4361-bd76-b2882ca001d3 req-82376c82-c922-41ea-82ad-f719fab6c424 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:25 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-a3ba72dc-8eb6-4361-bd76-b2882ca001d3 req-82376c82-c922-41ea-82ad-f719fab6c424 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:25 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-a3ba72dc-8eb6-4361-bd76-b2882ca001d3 req-82376c82-c922-41ea-82ad-f719fab6c424 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:25 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-a3ba72dc-8eb6-4361-bd76-b2882ca001d3 req-82376c82-c922-41ea-82ad-f719fab6c424 service nova] Creating event network-vif-plugged:1887cbf2-46d7-4b36-b8a4-83012bf1cb9f for instance 1b067df0-2ea8-44e6-9418-98788edf4e7d on user Apr 18 14:29:25 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-a3ba72dc-8eb6-4361-bd76-b2882ca001d3 req-82376c82-c922-41ea-82ad-f719fab6c424 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044435 Apr 18 14:29:25 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 24/72] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:27 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-ecd9a924-93a5-4c77-981a-c4df28619048 req-33239e15-29fe-487e-9902-dd819c09e62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b067df0-2ea8-44e6-9418-98788edf4e7d", "name": "network-vif-plugged", "status": "completed", "tag": "1887cbf2-46d7-4b36-b8a4-83012bf1cb9f"}, {"server_uuid": "909db006-c38d-4b50-acaa-4224aed6ea45", "name": "network-vif-plugged", "status": "completed", "tag": "f4b085c8-1069-40a4-8d8b-ebb5633472a6"}, {"server_uuid": "909db006-c38d-4b50-acaa-4224aed6ea45", "name": "network-vif-plugged", "status": "completed", "tag": "f4b085c8-1069-40a4-8d8b-ebb5633472a6"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:27 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-ecd9a924-93a5-4c77-981a-c4df28619048 req-33239e15-29fe-487e-9902-dd819c09e62e service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:27 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-ecd9a924-93a5-4c77-981a-c4df28619048 req-33239e15-29fe-487e-9902-dd819c09e62e service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:27 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-ecd9a924-93a5-4c77-981a-c4df28619048 req-33239e15-29fe-487e-9902-dd819c09e62e service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:27 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-ecd9a924-93a5-4c77-981a-c4df28619048 req-33239e15-29fe-487e-9902-dd819c09e62e service nova] Creating event network-vif-plugged:1887cbf2-46d7-4b36-b8a4-83012bf1cb9f for instance 1b067df0-2ea8-44e6-9418-98788edf4e7d on user Apr 18 14:29:27 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-ecd9a924-93a5-4c77-981a-c4df28619048 req-33239e15-29fe-487e-9902-dd819c09e62e service nova] Creating event network-vif-plugged:f4b085c8-1069-40a4-8d8b-ebb5633472a6 for instance 909db006-c38d-4b50-acaa-4224aed6ea45 on user Apr 18 14:29:27 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-ecd9a924-93a5-4c77-981a-c4df28619048 req-33239e15-29fe-487e-9902-dd819c09e62e service nova] Creating event network-vif-plugged:f4b085c8-1069-40a4-8d8b-ebb5633472a6 for instance 909db006-c38d-4b50-acaa-4224aed6ea45 on user Apr 18 14:29:27 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-ecd9a924-93a5-4c77-981a-c4df28619048 req-33239e15-29fe-487e-9902-dd819c09e62e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047277 Apr 18 14:29:27 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 26/73] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:27 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:28 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=16 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:28 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-e9682026-c5b7-49b1-ad53-0d566fd85e02 req-51e86838-5b6f-49ed-9428-ad44fa103c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5323297-c840-4fd6-9a76-727ed36de870", "name": "network-vif-plugged", "status": "completed", "tag": "1c41c5ca-21a5-4ea1-9a38-7c78341ea267"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:28 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-e9682026-c5b7-49b1-ad53-0d566fd85e02 req-51e86838-5b6f-49ed-9428-ad44fa103c85 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:28 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-e9682026-c5b7-49b1-ad53-0d566fd85e02 req-51e86838-5b6f-49ed-9428-ad44fa103c85 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:28 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-e9682026-c5b7-49b1-ad53-0d566fd85e02 req-51e86838-5b6f-49ed-9428-ad44fa103c85 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:28 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-e9682026-c5b7-49b1-ad53-0d566fd85e02 req-51e86838-5b6f-49ed-9428-ad44fa103c85 service nova] Creating event network-vif-plugged:1c41c5ca-21a5-4ea1-9a38-7c78341ea267 for instance e5323297-c840-4fd6-9a76-727ed36de870 on user Apr 18 14:29:28 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-e9682026-c5b7-49b1-ad53-0d566fd85e02 req-51e86838-5b6f-49ed-9428-ad44fa103c85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066142 Apr 18 14:29:28 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 24/74] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 14:29:30 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-e5dc7c8c-d6bc-49c5-a4c5-84b485e8ca6f req-2811d85a-1dd6-4bbb-9b65-aa9d7781cc4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5323297-c840-4fd6-9a76-727ed36de870", "name": "network-vif-plugged", "status": "completed", "tag": "1c41c5ca-21a5-4ea1-9a38-7c78341ea267"}, {"server_uuid": "6dcffb71-055a-4ae6-bf65-df885c035e5a", "name": "network-vif-plugged", "status": "completed", "tag": "598909ff-6d80-4f39-91d5-a53ca08f248d"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-e5dc7c8c-d6bc-49c5-a4c5-84b485e8ca6f req-2811d85a-1dd6-4bbb-9b65-aa9d7781cc4c service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-e5dc7c8c-d6bc-49c5-a4c5-84b485e8ca6f req-2811d85a-1dd6-4bbb-9b65-aa9d7781cc4c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-e5dc7c8c-d6bc-49c5-a4c5-84b485e8ca6f req-2811d85a-1dd6-4bbb-9b65-aa9d7781cc4c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:30 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-e5dc7c8c-d6bc-49c5-a4c5-84b485e8ca6f req-2811d85a-1dd6-4bbb-9b65-aa9d7781cc4c service nova] Creating event network-vif-plugged:1c41c5ca-21a5-4ea1-9a38-7c78341ea267 for instance e5323297-c840-4fd6-9a76-727ed36de870 on user Apr 18 14:29:30 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-e5dc7c8c-d6bc-49c5-a4c5-84b485e8ca6f req-2811d85a-1dd6-4bbb-9b65-aa9d7781cc4c service nova] Creating event network-vif-plugged:598909ff-6d80-4f39-91d5-a53ca08f248d for instance 6dcffb71-055a-4ae6-bf65-df885c035e5a on user Apr 18 14:29:30 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-e5dc7c8c-d6bc-49c5-a4c5-84b485e8ca6f req-2811d85a-1dd6-4bbb-9b65-aa9d7781cc4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102483 Apr 18 14:29:30 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 25/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 14:29:32 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-8eb72835-4b36-4ae6-8ee9-c65432de59ea req-bfb71501-8bcc-4241-bab2-6274389158f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f7c5ef9-09d6-477f-90a8-e6673f75b2cf", "tag": "08bbe937-9331-46f0-a09e-06ca352d0e25"}, {"server_uuid": "6dcffb71-055a-4ae6-bf65-df885c035e5a", "name": "network-vif-plugged", "status": "completed", "tag": "598909ff-6d80-4f39-91d5-a53ca08f248d"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:32 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-8eb72835-4b36-4ae6-8ee9-c65432de59ea req-bfb71501-8bcc-4241-bab2-6274389158f2 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:32 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-8eb72835-4b36-4ae6-8ee9-c65432de59ea req-bfb71501-8bcc-4241-bab2-6274389158f2 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:32 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-8eb72835-4b36-4ae6-8ee9-c65432de59ea req-bfb71501-8bcc-4241-bab2-6274389158f2 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:32 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-8eb72835-4b36-4ae6-8ee9-c65432de59ea req-bfb71501-8bcc-4241-bab2-6274389158f2 service nova] Creating event network-changed:08bbe937-9331-46f0-a09e-06ca352d0e25 for instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf on user Apr 18 14:29:32 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-8eb72835-4b36-4ae6-8ee9-c65432de59ea req-bfb71501-8bcc-4241-bab2-6274389158f2 service nova] Creating event network-vif-plugged:598909ff-6d80-4f39-91d5-a53ca08f248d for instance 6dcffb71-055a-4ae6-bf65-df885c035e5a on user Apr 18 14:29:32 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-8eb72835-4b36-4ae6-8ee9-c65432de59ea req-bfb71501-8bcc-4241-bab2-6274389158f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.054237 Apr 18 14:29:32 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 27/76] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:32 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:36 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:36 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-37a3e753-6e2f-4848-b402-7350bd625eda req-cb4dc4db-1237-495f-9549-8ed17a31b72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7c5ef9-09d6-477f-90a8-e6673f75b2cf", "name": "network-vif-plugged", "status": "completed", "tag": "08bbe937-9331-46f0-a09e-06ca352d0e25"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:36 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-37a3e753-6e2f-4848-b402-7350bd625eda req-cb4dc4db-1237-495f-9549-8ed17a31b72d service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:36 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-37a3e753-6e2f-4848-b402-7350bd625eda req-cb4dc4db-1237-495f-9549-8ed17a31b72d service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:36 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-37a3e753-6e2f-4848-b402-7350bd625eda req-cb4dc4db-1237-495f-9549-8ed17a31b72d service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:36 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-37a3e753-6e2f-4848-b402-7350bd625eda req-cb4dc4db-1237-495f-9549-8ed17a31b72d service nova] Creating event network-vif-plugged:08bbe937-9331-46f0-a09e-06ca352d0e25 for instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf on user Apr 18 14:29:36 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-37a3e753-6e2f-4848-b402-7350bd625eda req-cb4dc4db-1237-495f-9549-8ed17a31b72d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075700 Apr 18 14:29:36 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 25/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:37 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:37 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:37 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-8c728873-91be-41aa-9b19-c1fbf53e6965 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Action: 'create', calling method: .version_select at 0x7f5ceec1f1c0>, body: {"keypair": {"name": "tempest-keypair-443542451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0CEt3c/NwvRaSeTffMLzOx56InCNaz7V9Vij4e62ibIGj5r13yGcbXNM8jSZXHQhtG1FcsWCrF0XRz0t1ajqq9ycF5T7fDS4z2KWMKpP1rkf7mAgL6FlRR8Pl1phiSGQ=="}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:37 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:37 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-8c728873-91be-41aa-9b19-c1fbf53e6965 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Getting quotas for project 2d1e17fb95d64cae9c6c210d143d115b. Resources: {'key_pairs'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:29:37 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-8c728873-91be-41aa-9b19-c1fbf53e6965 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Getting quotas for user 2039b3016f884a42abcb58054d649cee and project 2d1e17fb95d64cae9c6c210d143d115b. Resources: {'key_pairs'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:29:37 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-8c728873-91be-41aa-9b19-c1fbf53e6965 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.505853 Apr 18 14:29:37 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 26/78] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:29:37 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:38 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:38 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=18 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:38 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-80df56f8-d42b-4f62-89b7-7771350e1136 req-d3fd312b-5e55-4f0e-a2cc-a6be56509590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7c5ef9-09d6-477f-90a8-e6673f75b2cf", "name": "network-vif-plugged", "status": "completed", "tag": "08bbe937-9331-46f0-a09e-06ca352d0e25"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:38 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:38 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-80df56f8-d42b-4f62-89b7-7771350e1136 req-d3fd312b-5e55-4f0e-a2cc-a6be56509590 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:38 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-80df56f8-d42b-4f62-89b7-7771350e1136 req-d3fd312b-5e55-4f0e-a2cc-a6be56509590 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:38 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-80df56f8-d42b-4f62-89b7-7771350e1136 req-d3fd312b-5e55-4f0e-a2cc-a6be56509590 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:38 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-80df56f8-d42b-4f62-89b7-7771350e1136 req-d3fd312b-5e55-4f0e-a2cc-a6be56509590 service nova] Creating event network-vif-plugged:08bbe937-9331-46f0-a09e-06ca352d0e25 for instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf on user Apr 18 14:29:38 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-80df56f8-d42b-4f62-89b7-7771350e1136 req-d3fd312b-5e55-4f0e-a2cc-a6be56509590 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068109 Apr 18 14:29:38 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 28/79] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:40 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-59d1db11-bc8a-443c-84e5-af3637d90ee0 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Action: 'create', calling method: .version_select at 0x7f5cef4bd750>, body: {"keypair": {"name": "tempest-keypair-998303201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2bHkODKFfnb6J3zSzgra9BqnzYuT4DB5EK+mUJc38K8eFOd6fuhc5SXEx2FAlo1KQZQPcq62Djy4XT7gAVKQymi9nFGrXlwGdElS8oymqTE+1k/4xGT9iP2cEJkYHNSQ=="}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:40 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=7 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:40 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-59d1db11-bc8a-443c-84e5-af3637d90ee0 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Getting quotas for project 7cb471110565402aa21064786951ab00. Resources: {'key_pairs'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:29:40 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-59d1db11-bc8a-443c-84e5-af3637d90ee0 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Getting quotas for user 6b50d25047934c9fad65b69209730a0e and project 7cb471110565402aa21064786951ab00. Resources: {'key_pairs'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:29:40 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-59d1db11-bc8a-443c-84e5-af3637d90ee0 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.498483 Apr 18 14:29:40 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 26/80] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:29:40 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:42 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=12 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:42 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-379039108", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "networks": [{"uuid": "8d05425b-4ecd-432b-b6c7-ca9f78114449"}], "security_groups": [{"name": "tempest-securitygroup--870063037"}], "key_name": "tempest-keypair-443542451", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:42 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] validate_networks() for [('8d05425b-4ecd-432b-b6c7-ca9f78114449', None, None, None, None, None)] {{(pid=61309) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:29:44 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2134284850", "imageRef": "676a92ee-abbd-4bdd-b113-00b8dca91436", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "9fccc2aa-a9be-48a0-b60b-f5ecaa90b02f"}], "security_groups": [{"name": "tempest-securitygroup--1880025038"}], "key_name": "tempest-keypair-998303201", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Flavor limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Image limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Flavor pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Image pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Getting quotas for project 2d1e17fb95d64cae9c6c210d143d115b. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Getting quotas for user 2039b3016f884a42abcb58054d649cee and project 2d1e17fb95d64cae9c6c210d143d115b. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Going to run 1 instances... {{(pid=61309) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:29:44 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 6d6793c2-2b28-4337-baf2-9fd9b4e70a36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61309) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:29:44 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-e17d1976-fb4a-437a-9202-f140fed2741b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.563856 Apr 18 14:29:44 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 27/81] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:29:42 2023] POST /compute/v2.1/servers => generated 403 bytes in 2565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:29:44 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-64d4ff19-b730-417a-97a4-87218f201226 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:29:44 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-64d4ff19-b730-417a-97a4-87218f201226 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 6d6793c2-2b28-4337-baf2-9fd9b4e70a36] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:29:44 user devstack@n-api.service[61310]: DEBUG nova.network.neutron [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] validate_networks() for [('9fccc2aa-a9be-48a0-b60b-f5ecaa90b02f', None, None, None, None, None)] {{(pid=61310) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:29:44 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-64d4ff19-b730-417a-97a4-87218f201226 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039b3016f884a42abcb58054d649cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1e17fb95d64cae9c6c210d143d115b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:29:44 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-64d4ff19-b730-417a-97a4-87218f201226 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36" status: 200 len: 1234 microversion: 2.1 time: 0.156745 Apr 18 14:29:44 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 27/82] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:29:44 2023] GET /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36 => generated 1234 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Flavor limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Image limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Flavor pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Image pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Getting quotas for project 7cb471110565402aa21064786951ab00. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Getting quotas for user 6b50d25047934c9fad65b69209730a0e and project 7cb471110565402aa21064786951ab00. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Going to run 1 instances... {{(pid=61310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:29:46 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] [instance: 51b6bf0a-d424-43fe-b5fd-3a6843bb1672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='676a92ee-abbd-4bdd-b113-00b8dca91436',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:29:46 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-9a400f82-484c-4581-a0ff-7cd475c4b6cc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.080832 Apr 18 14:29:46 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 29/83] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:29:44 2023] POST /compute/v2.1/servers => generated 404 bytes in 2084 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:29:46 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-6192142f-9cfe-40ca-bc7a-caf63d09c130 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:29:46 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-6192142f-9cfe-40ca-bc7a-caf63d09c130 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] [instance: 51b6bf0a-d424-43fe-b5fd-3a6843bb1672] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:29:47 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-6192142f-9cfe-40ca-bc7a-caf63d09c130 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b50d25047934c9fad65b69209730a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb471110565402aa21064786951ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:29:47 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-6192142f-9cfe-40ca-bc7a-caf63d09c130 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672" status: 200 len: 1239 microversion: 2.1 time: 0.643193 Apr 18 14:29:47 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 28/84] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:29:46 2023] GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672 => generated 1239 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:29:47 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=14 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:48 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-4b4d69b8-d381-4973-a05d-0eded0c33692 req-2c41f500-ac61-4bf8-8df7-5c3f632c190a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d6793c2-2b28-4337-baf2-9fd9b4e70a36", "tag": "5d2983d3-2e25-4dfd-9dd0-28dbe2111d62"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:48 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-42816741-d696-477c-a4d6-1f50fc867fe1 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Action: 'create', calling method: .version_select at 0x7f5cef4be290>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2086565500", "metadata": {"Type": "work"}}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-4b4d69b8-d381-4973-a05d-0eded0c33692 req-2c41f500-ac61-4bf8-8df7-5c3f632c190a service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-4b4d69b8-d381-4973-a05d-0eded0c33692 req-2c41f500-ac61-4bf8-8df7-5c3f632c190a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-4b4d69b8-d381-4973-a05d-0eded0c33692 req-2c41f500-ac61-4bf8-8df7-5c3f632c190a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:48 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-42816741-d696-477c-a4d6-1f50fc867fe1 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Request method failure captured: Apr 18 14:29:48 user devstack@n-api.service[61311]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 14:29:48 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:29:48 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:29:48 user devstack@n-api.service[61311]: Connection: close Apr 18 14:29:48 user devstack@n-api.service[61311]: Content-Length: 122 Apr 18 14:29:48 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:29:48 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:29:48 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:29:48 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqlb3nrz8EC7HYwkPcRNDf8gzBkbfKdK-_6nuhR73-rYFMd9CnLeC9RZg0-9EN3SR0QJOjwJHCC50j44_KPOQyc2NNbCx4fTBagjIma0tbuZwHQh1H_oOm4WhpWXzV_mmRD4AcrAyQeAXDspeZ-57HSLUzHnCHGJarOKgoIr3LxO0Js Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Project-Id: 2348f7dde6b84c94a23c9cf5aa7ce1c4 Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Project-Name: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Tenant: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Tenant-Id: 2348f7dde6b84c94a23c9cf5aa7ce1c4 Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61311]: X-User: tempest-VolumesNegativeTest-929822360-project-member Apr 18 14:29:48 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:29:48 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:29:48 user devstack@n-api.service[61311]: X-User-Id: 81f1ff0222ae4a5b8188351dcf6a32df Apr 18 14:29:48 user devstack@n-api.service[61311]: X-User-Name: tempest-VolumesNegativeTest-929822360-project-member Apr 18 14:29:48 user devstack@n-api.service[61311]: Apr 18 14:29:48 user devstack@n-api.service[61311]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2086565500", "metadata": {"Type": "work"}}} Apr 18 14:29:48 user devstack@n-api.service[61311]: method: Apr 18 14:29:48 user devstack@n-api.service[61311]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 14:29:48 user devstack@n-api.service[61311]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2086565500', 'metadata': {'Type': 'work'}}}} Apr 18 14:29:48 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise error Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi '#$%' Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-42816741-d696-477c-a4d6-1f50fc867fe1 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:29:48 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-42816741-d696-477c-a4d6-1f50fc867fe1 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.198095 Apr 18 14:29:48 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 28/85] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 14:29:47 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 14:29:48 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=13 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:48 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-3201486b-5f5a-474b-8002-5ada2966c71b tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Action: 'create', calling method: .version_select at 0x7f5ceec74430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1997163359", "metadata": {"Type": "work"}}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-4b4d69b8-d381-4973-a05d-0eded0c33692 req-2c41f500-ac61-4bf8-8df7-5c3f632c190a service nova] Creating event network-changed:5d2983d3-2e25-4dfd-9dd0-28dbe2111d62 for instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 on user Apr 18 14:29:48 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-3201486b-5f5a-474b-8002-5ada2966c71b tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Request method failure captured: Apr 18 14:29:48 user devstack@n-api.service[61309]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 14:29:48 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:29:48 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:29:48 user devstack@n-api.service[61309]: Connection: close Apr 18 14:29:48 user devstack@n-api.service[61309]: Content-Length: 120 Apr 18 14:29:48 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:29:48 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:29:48 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:29:48 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqlb3nrz8EC7HYwkPcRNDf8gzBkbfKdK-_6nuhR73-rYFMd9CnLeC9RZg0-9EN3SR0QJOjwJHCC50j44_KPOQyc2NNbCx4fTBagjIma0tbuZwHQh1H_oOm4WhpWXzV_mmRD4AcrAyQeAXDspeZ-57HSLUzHnCHGJarOKgoIr3LxO0Js Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Project-Id: 2348f7dde6b84c94a23c9cf5aa7ce1c4 Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Project-Name: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Tenant: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Tenant-Id: 2348f7dde6b84c94a23c9cf5aa7ce1c4 Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61309]: X-User: tempest-VolumesNegativeTest-929822360-project-member Apr 18 14:29:48 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:29:48 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:29:48 user devstack@n-api.service[61309]: X-User-Id: 81f1ff0222ae4a5b8188351dcf6a32df Apr 18 14:29:48 user devstack@n-api.service[61309]: X-User-Name: tempest-VolumesNegativeTest-929822360-project-member Apr 18 14:29:48 user devstack@n-api.service[61309]: Apr 18 14:29:48 user devstack@n-api.service[61309]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1997163359", "metadata": {"Type": "work"}}} Apr 18 14:29:48 user devstack@n-api.service[61309]: method: Apr 18 14:29:48 user devstack@n-api.service[61309]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 14:29:48 user devstack@n-api.service[61309]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1997163359', 'metadata': {'Type': 'work'}}}} Apr 18 14:29:48 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise error Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi '0' Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-4b4d69b8-d381-4973-a05d-0eded0c33692 req-2c41f500-ac61-4bf8-8df7-5c3f632c190a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054060 Apr 18 14:29:48 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 30/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:48 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-3201486b-5f5a-474b-8002-5ada2966c71b tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:29:48 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-3201486b-5f5a-474b-8002-5ada2966c71b tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018298 Apr 18 14:29:48 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 29/87] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 14:29:48 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 18 14:29:48 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-c6054539-d44a-4265-9b9f-01bedfe39320 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Action: 'create', calling method: .version_select at 0x7f5cef50ca60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1302040593", "metadata": {"Type": "work"}}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:48 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-c6054539-d44a-4265-9b9f-01bedfe39320 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Request method failure captured: Apr 18 14:29:48 user devstack@n-api.service[61311]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 14:29:48 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:29:48 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:29:48 user devstack@n-api.service[61311]: Connection: close Apr 18 14:29:48 user devstack@n-api.service[61311]: Content-Length: 119 Apr 18 14:29:48 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:29:48 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:29:48 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:29:48 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqlb3nrz8EC7HYwkPcRNDf8gzBkbfKdK-_6nuhR73-rYFMd9CnLeC9RZg0-9EN3SR0QJOjwJHCC50j44_KPOQyc2NNbCx4fTBagjIma0tbuZwHQh1H_oOm4WhpWXzV_mmRD4AcrAyQeAXDspeZ-57HSLUzHnCHGJarOKgoIr3LxO0Js Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Project-Id: 2348f7dde6b84c94a23c9cf5aa7ce1c4 Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Project-Name: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Tenant: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Tenant-Id: 2348f7dde6b84c94a23c9cf5aa7ce1c4 Apr 18 14:29:48 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61311]: X-User: tempest-VolumesNegativeTest-929822360-project-member Apr 18 14:29:48 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:29:48 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:29:48 user devstack@n-api.service[61311]: X-User-Id: 81f1ff0222ae4a5b8188351dcf6a32df Apr 18 14:29:48 user devstack@n-api.service[61311]: X-User-Name: tempest-VolumesNegativeTest-929822360-project-member Apr 18 14:29:48 user devstack@n-api.service[61311]: Apr 18 14:29:48 user devstack@n-api.service[61311]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1302040593", "metadata": {"Type": "work"}}} Apr 18 14:29:48 user devstack@n-api.service[61311]: method: Apr 18 14:29:48 user devstack@n-api.service[61311]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 14:29:48 user devstack@n-api.service[61311]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1302040593', 'metadata': {'Type': 'work'}}}} Apr 18 14:29:48 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise error Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi '' Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 14:29:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-c6054539-d44a-4265-9b9f-01bedfe39320 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:29:48 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-c6054539-d44a-4265-9b9f-01bedfe39320 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009111 Apr 18 14:29:48 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 29/88] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 14:29:48 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 14:29:48 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-33aa94c8-4722-4aa6-99f4-a2cc5663f6b9 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Calling method '.version_select at 0x7f5ceec27b50>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:29:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-33aa94c8-4722-4aa6-99f4-a2cc5663f6b9 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] HTTP exception thrown: Volume tempest-invalid-180560066 could not be found. Apr 18 14:29:48 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-33aa94c8-4722-4aa6-99f4-a2cc5663f6b9 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Request method failure captured: Apr 18 14:29:48 user devstack@n-api.service[61310]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-180560066 HTTP/1.1 Apr 18 14:29:48 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:29:48 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:29:48 user devstack@n-api.service[61310]: Connection: close Apr 18 14:29:48 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:29:48 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:29:48 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:29:48 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:29:48 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqlb3nrz8EC7HYwkPcRNDf8gzBkbfKdK-_6nuhR73-rYFMd9CnLeC9RZg0-9EN3SR0QJOjwJHCC50j44_KPOQyc2NNbCx4fTBagjIma0tbuZwHQh1H_oOm4WhpWXzV_mmRD4AcrAyQeAXDspeZ-57HSLUzHnCHGJarOKgoIr3LxO0Js Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Project-Id: 2348f7dde6b84c94a23c9cf5aa7ce1c4 Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Project-Name: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Tenant: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Tenant-Id: 2348f7dde6b84c94a23c9cf5aa7ce1c4 Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61310]: X-User: tempest-VolumesNegativeTest-929822360-project-member Apr 18 14:29:48 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:29:48 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:29:48 user devstack@n-api.service[61310]: X-User-Id: 81f1ff0222ae4a5b8188351dcf6a32df Apr 18 14:29:48 user devstack@n-api.service[61310]: X-User-Name: tempest-VolumesNegativeTest-929822360-project-member Apr 18 14:29:48 user devstack@n-api.service[61310]: method: Apr 18 14:29:48 user devstack@n-api.service[61310]: exception: Volume tempest-invalid-180560066 could not be found. Apr 18 14:29:48 user devstack@n-api.service[61310]: action_args: {'id': 'tempest-invalid-180560066'} Apr 18 14:29:48 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-180560066 could not be found. (HTTP 404) (Request-ID: req-5cb45978-3ea4-4fbf-81d2-503e8efba191) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-180560066 could not be found. Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-180560066 could not be found. Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-180560066 could not be found. Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-33aa94c8-4722-4aa6-99f4-a2cc5663f6b9 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Returning 404 to user: Volume tempest-invalid-180560066 could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:29:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-33aa94c8-4722-4aa6-99f4-a2cc5663f6b9 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-180560066" status: 404 len: 98 microversion: 2.1 time: 0.051065 Apr 18 14:29:48 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 31/89] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 18 14:29:48 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-180560066 => generated 98 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 18 14:29:48 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-0a35df50-999c-41a6-86b6-f2639bd15596 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007176 Apr 18 14:29:48 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 30/90] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 18 14:29:48 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 14:29:48 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-5b1247ef-38e2-4ffd-91dc-0b3c73c84c71 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004677 Apr 18 14:29:48 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 30/91] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 18 14:29:48 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 14:29:48 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-adc7215c-147c-4dfb-9c7c-b4b3371a4b97 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Calling method '.version_select at 0x7f5cf00912d0>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:29:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-adc7215c-147c-4dfb-9c7c-b4b3371a4b97 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] HTTP exception thrown: Volume 1f755920-150c-40a5-af08-43fe53eb599e could not be found. Apr 18 14:29:48 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-adc7215c-147c-4dfb-9c7c-b4b3371a4b97 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Request method failure captured: Apr 18 14:29:48 user devstack@n-api.service[61310]: request: DELETE /compute/v2.1/os-volumes/1f755920-150c-40a5-af08-43fe53eb599e HTTP/1.1 Apr 18 14:29:48 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:29:48 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:29:48 user devstack@n-api.service[61310]: Connection: close Apr 18 14:29:48 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:29:48 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:29:48 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:29:48 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:29:48 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqlb3nrz8EC7HYwkPcRNDf8gzBkbfKdK-_6nuhR73-rYFMd9CnLeC9RZg0-9EN3SR0QJOjwJHCC50j44_KPOQyc2NNbCx4fTBagjIma0tbuZwHQh1H_oOm4WhpWXzV_mmRD4AcrAyQeAXDspeZ-57HSLUzHnCHGJarOKgoIr3LxO0Js Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Project-Id: 2348f7dde6b84c94a23c9cf5aa7ce1c4 Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Project-Name: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Tenant: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Tenant-Id: 2348f7dde6b84c94a23c9cf5aa7ce1c4 Apr 18 14:29:48 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61310]: X-User: tempest-VolumesNegativeTest-929822360-project-member Apr 18 14:29:48 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:29:48 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:29:48 user devstack@n-api.service[61310]: X-User-Id: 81f1ff0222ae4a5b8188351dcf6a32df Apr 18 14:29:48 user devstack@n-api.service[61310]: X-User-Name: tempest-VolumesNegativeTest-929822360-project-member Apr 18 14:29:48 user devstack@n-api.service[61310]: method: Apr 18 14:29:48 user devstack@n-api.service[61310]: exception: Volume 1f755920-150c-40a5-af08-43fe53eb599e could not be found. Apr 18 14:29:48 user devstack@n-api.service[61310]: action_args: {'id': '1f755920-150c-40a5-af08-43fe53eb599e'} Apr 18 14:29:48 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f755920-150c-40a5-af08-43fe53eb599e could not be found. (HTTP 404) (Request-ID: req-7bcea43f-aae6-4e03-8e3c-784766ef8c79) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f755920-150c-40a5-af08-43fe53eb599e could not be found. Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f755920-150c-40a5-af08-43fe53eb599e could not be found. Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f755920-150c-40a5-af08-43fe53eb599e could not be found. Apr 18 14:29:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-adc7215c-147c-4dfb-9c7c-b4b3371a4b97 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Returning 404 to user: Volume 1f755920-150c-40a5-af08-43fe53eb599e could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:29:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-adc7215c-147c-4dfb-9c7c-b4b3371a4b97 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/1f755920-150c-40a5-af08-43fe53eb599e" status: 404 len: 109 microversion: 2.1 time: 0.054988 Apr 18 14:29:48 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 32/92] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 14:29:48 2023] DELETE /compute/v2.1/os-volumes/1f755920-150c-40a5-af08-43fe53eb599e => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:29:48 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-cef97610-e24c-431a-a397-6772b3930749 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Calling method '.version_select at 0x7f5ceec76950>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:29:48 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-cef97610-e24c-431a-a397-6772b3930749 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] HTTP exception thrown: Volume ca02ce05-a3d6-4073-bcd3-b229655aa07a could not be found. Apr 18 14:29:48 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-cef97610-e24c-431a-a397-6772b3930749 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Request method failure captured: Apr 18 14:29:48 user devstack@n-api.service[61309]: request: GET /compute/v2.1/os-volumes/ca02ce05-a3d6-4073-bcd3-b229655aa07a HTTP/1.1 Apr 18 14:29:48 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:29:48 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:29:48 user devstack@n-api.service[61309]: Connection: close Apr 18 14:29:48 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:29:48 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:29:48 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:29:48 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:29:48 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqlb3nrz8EC7HYwkPcRNDf8gzBkbfKdK-_6nuhR73-rYFMd9CnLeC9RZg0-9EN3SR0QJOjwJHCC50j44_KPOQyc2NNbCx4fTBagjIma0tbuZwHQh1H_oOm4WhpWXzV_mmRD4AcrAyQeAXDspeZ-57HSLUzHnCHGJarOKgoIr3LxO0Js Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Project-Id: 2348f7dde6b84c94a23c9cf5aa7ce1c4 Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Project-Name: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2348f7dde6b84c94a23c9cf5aa7ce1c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Tenant: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Tenant-Id: 2348f7dde6b84c94a23c9cf5aa7ce1c4 Apr 18 14:29:48 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-VolumesNegativeTest-929822360 Apr 18 14:29:48 user devstack@n-api.service[61309]: X-User: tempest-VolumesNegativeTest-929822360-project-member Apr 18 14:29:48 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:29:48 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:29:48 user devstack@n-api.service[61309]: X-User-Id: 81f1ff0222ae4a5b8188351dcf6a32df Apr 18 14:29:48 user devstack@n-api.service[61309]: X-User-Name: tempest-VolumesNegativeTest-929822360-project-member Apr 18 14:29:48 user devstack@n-api.service[61309]: method: Apr 18 14:29:48 user devstack@n-api.service[61309]: exception: Volume ca02ce05-a3d6-4073-bcd3-b229655aa07a could not be found. Apr 18 14:29:48 user devstack@n-api.service[61309]: action_args: {'id': 'ca02ce05-a3d6-4073-bcd3-b229655aa07a'} Apr 18 14:29:48 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca02ce05-a3d6-4073-bcd3-b229655aa07a could not be found. (HTTP 404) (Request-ID: req-d2aa87b5-8076-4c30-8e8a-3b497e68b180) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca02ce05-a3d6-4073-bcd3-b229655aa07a could not be found. Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca02ce05-a3d6-4073-bcd3-b229655aa07a could not be found. Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca02ce05-a3d6-4073-bcd3-b229655aa07a could not be found. Apr 18 14:29:48 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:29:48 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-cef97610-e24c-431a-a397-6772b3930749 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] Returning 404 to user: Volume ca02ce05-a3d6-4073-bcd3-b229655aa07a could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:29:48 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-cef97610-e24c-431a-a397-6772b3930749 tempest-VolumesNegativeTest-929822360 tempest-VolumesNegativeTest-929822360-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ca02ce05-a3d6-4073-bcd3-b229655aa07a" status: 404 len: 109 microversion: 2.1 time: 0.063527 Apr 18 14:29:48 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 31/93] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 14:29:48 2023] GET /compute/v2.1/os-volumes/ca02ce05-a3d6-4073-bcd3-b229655aa07a => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:29:51 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-7fe3cb46-58d8-4828-952d-431d4fd484e8 req-1e5129f4-d591-47dd-956a-65ffdc39805a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6793c2-2b28-4337-baf2-9fd9b4e70a36", "name": "network-vif-plugged", "status": "completed", "tag": "5d2983d3-2e25-4dfd-9dd0-28dbe2111d62"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-7fe3cb46-58d8-4828-952d-431d4fd484e8 req-1e5129f4-d591-47dd-956a-65ffdc39805a service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-7fe3cb46-58d8-4828-952d-431d4fd484e8 req-1e5129f4-d591-47dd-956a-65ffdc39805a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-7fe3cb46-58d8-4828-952d-431d4fd484e8 req-1e5129f4-d591-47dd-956a-65ffdc39805a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:51 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-7fe3cb46-58d8-4828-952d-431d4fd484e8 req-1e5129f4-d591-47dd-956a-65ffdc39805a service nova] Creating event network-vif-plugged:5d2983d3-2e25-4dfd-9dd0-28dbe2111d62 for instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 on user Apr 18 14:29:51 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-7fe3cb46-58d8-4828-952d-431d4fd484e8 req-1e5129f4-d591-47dd-956a-65ffdc39805a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050552 Apr 18 14:29:51 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:52 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-3b196d61-cedd-4719-9f80-99b6428891ca req-dfd30fc6-2777-4f03-8959-6e942cad70ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b6bf0a-d424-43fe-b5fd-3a6843bb1672", "tag": "9e209b67-100e-4779-abbd-38cfc3b4568a"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-3b196d61-cedd-4719-9f80-99b6428891ca req-dfd30fc6-2777-4f03-8959-6e942cad70ad service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-3b196d61-cedd-4719-9f80-99b6428891ca req-dfd30fc6-2777-4f03-8959-6e942cad70ad service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-3b196d61-cedd-4719-9f80-99b6428891ca req-dfd30fc6-2777-4f03-8959-6e942cad70ad service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:52 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-3b196d61-cedd-4719-9f80-99b6428891ca req-dfd30fc6-2777-4f03-8959-6e942cad70ad service nova] Creating event network-changed:9e209b67-100e-4779-abbd-38cfc3b4568a for instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 on user Apr 18 14:29:52 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-3b196d61-cedd-4719-9f80-99b6428891ca req-dfd30fc6-2777-4f03-8959-6e942cad70ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044623 Apr 18 14:29:52 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 33/95] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:53 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-a090c527-f50f-411e-86cf-1c06e980a0ce req-1b87ea6e-bec3-4b6f-b8d4-d4ba87741a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6793c2-2b28-4337-baf2-9fd9b4e70a36", "name": "network-vif-plugged", "status": "completed", "tag": "5d2983d3-2e25-4dfd-9dd0-28dbe2111d62"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:53 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-a090c527-f50f-411e-86cf-1c06e980a0ce req-1b87ea6e-bec3-4b6f-b8d4-d4ba87741a51 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:53 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-a090c527-f50f-411e-86cf-1c06e980a0ce req-1b87ea6e-bec3-4b6f-b8d4-d4ba87741a51 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:53 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-a090c527-f50f-411e-86cf-1c06e980a0ce req-1b87ea6e-bec3-4b6f-b8d4-d4ba87741a51 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:53 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-a090c527-f50f-411e-86cf-1c06e980a0ce req-1b87ea6e-bec3-4b6f-b8d4-d4ba87741a51 service nova] Creating event network-vif-plugged:5d2983d3-2e25-4dfd-9dd0-28dbe2111d62 for instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 on user Apr 18 14:29:53 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-a090c527-f50f-411e-86cf-1c06e980a0ce req-1b87ea6e-bec3-4b6f-b8d4-d4ba87741a51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036463 Apr 18 14:29:53 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:55 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:55 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-3f51606b-03d4-4fd2-abcc-0d773e1c25ad req-baf97e0e-332c-4697-ab8b-c977184f87ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b6bf0a-d424-43fe-b5fd-3a6843bb1672", "name": "network-vif-plugged", "status": "completed", "tag": "9e209b67-100e-4779-abbd-38cfc3b4568a"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-3f51606b-03d4-4fd2-abcc-0d773e1c25ad req-baf97e0e-332c-4697-ab8b-c977184f87ee service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-3f51606b-03d4-4fd2-abcc-0d773e1c25ad req-baf97e0e-332c-4697-ab8b-c977184f87ee service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-3f51606b-03d4-4fd2-abcc-0d773e1c25ad req-baf97e0e-332c-4697-ab8b-c977184f87ee service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:55 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-3f51606b-03d4-4fd2-abcc-0d773e1c25ad req-baf97e0e-332c-4697-ab8b-c977184f87ee service nova] Creating event network-vif-plugged:9e209b67-100e-4779-abbd-38cfc3b4568a for instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 on user Apr 18 14:29:55 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-3f51606b-03d4-4fd2-abcc-0d773e1c25ad req-baf97e0e-332c-4697-ab8b-c977184f87ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054320 Apr 18 14:29:55 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 32/97] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:29:57 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:57 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:29:57 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-a231feca-8a53-4b9e-b757-7cd6dcd6ac05 req-11851354-734c-401c-925e-b52aa2953fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b6bf0a-d424-43fe-b5fd-3a6843bb1672", "name": "network-vif-plugged", "status": "completed", "tag": "9e209b67-100e-4779-abbd-38cfc3b4568a"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:29:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-a231feca-8a53-4b9e-b757-7cd6dcd6ac05 req-11851354-734c-401c-925e-b52aa2953fde service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:29:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-a231feca-8a53-4b9e-b757-7cd6dcd6ac05 req-11851354-734c-401c-925e-b52aa2953fde service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:29:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-a231feca-8a53-4b9e-b757-7cd6dcd6ac05 req-11851354-734c-401c-925e-b52aa2953fde service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:29:57 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-a231feca-8a53-4b9e-b757-7cd6dcd6ac05 req-11851354-734c-401c-925e-b52aa2953fde service nova] Creating event network-vif-plugged:9e209b67-100e-4779-abbd-38cfc3b4568a for instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 on user Apr 18 14:29:57 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-a231feca-8a53-4b9e-b757-7cd6dcd6ac05 req-11851354-734c-401c-925e-b52aa2953fde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039494 Apr 18 14:29:57 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 34/98] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:29:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:30:01 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:01 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=12 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:01 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-1bda18ae-1b7c-49e4-bb10-2af7a7a24fae tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:30:01 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-1bda18ae-1b7c-49e4-bb10-2af7a7a24fae tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 909db006-c38d-4b50-acaa-4224aed6ea45] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:30:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-1bda18ae-1b7c-49e4-bb10-2af7a7a24fae tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-1bda18ae-1b7c-49e4-bb10-2af7a7a24fae tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-1bda18ae-1b7c-49e4-bb10-2af7a7a24fae tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-1bda18ae-1b7c-49e4-bb10-2af7a7a24fae tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-1bda18ae-1b7c-49e4-bb10-2af7a7a24fae tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-1bda18ae-1b7c-49e4-bb10-2af7a7a24fae tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:01 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-1bda18ae-1b7c-49e4-bb10-2af7a7a24fae tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e284b794c4043768af56fd58fceb837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ca11d8beec4410a8a4c8ae7c8e4bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:30:01 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-1bda18ae-1b7c-49e4-bb10-2af7a7a24fae tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45" status: 200 len: 1502 microversion: 2.1 time: 0.514061 Apr 18 14:30:01 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 33/99] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:30:01 2023] GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45 => generated 1502 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:30:02 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-e49039a4-3dbc-4723-811f-12ab325e0d8a tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:30:02 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-e49039a4-3dbc-4723-811f-12ab325e0d8a tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: e5323297-c840-4fd6-9a76-727ed36de870] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:30:02 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e49039a4-3dbc-4723-811f-12ab325e0d8a tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:02 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e49039a4-3dbc-4723-811f-12ab325e0d8a tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:02 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e49039a4-3dbc-4723-811f-12ab325e0d8a tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:02 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e49039a4-3dbc-4723-811f-12ab325e0d8a tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:02 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e49039a4-3dbc-4723-811f-12ab325e0d8a tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:02 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e49039a4-3dbc-4723-811f-12ab325e0d8a tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:03 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-e49039a4-3dbc-4723-811f-12ab325e0d8a tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b209357fca7f40c0b52507a285e054e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312c2b6e41142799cb66dd1377558d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:30:03 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-e49039a4-3dbc-4723-811f-12ab325e0d8a tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870" status: 200 len: 1493 microversion: 2.1 time: 0.411282 Apr 18 14:30:03 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 33/100] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:30:02 2023] GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870 => generated 1493 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:30:04 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-3d6f4c93-fa5d-4277-abe2-e2836044b7a7 tempest-TestStampPattern-1749863168 tempest-TestStampPattern-1749863168-project-member] Action: 'create', calling method: .version_select at 0x7f5cf0091120>, body: {"keypair": {"name": "tempest-TestStampPattern-1346172718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfii9wWC5lkO+8XdtL/fvIApOGHn8oU5CR42uTiy74X5xThFOyOr6k54PEvopVBq9FyK7qnq1AQjgegx3ywHGp5CnPUcNv870Xlmcd5Zp6Ngkr+6Jovx2LjZqm5bn129w=="}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:30:04 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-3d6f4c93-fa5d-4277-abe2-e2836044b7a7 tempest-TestStampPattern-1749863168 tempest-TestStampPattern-1749863168-project-member] Getting quotas for project d968da29136f49d5aed98824bfd99ad9. Resources: {'key_pairs'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:30:04 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-3d6f4c93-fa5d-4277-abe2-e2836044b7a7 tempest-TestStampPattern-1749863168 tempest-TestStampPattern-1749863168-project-member] Getting quotas for user f1369c31a7e44a5e9fc458283f1fc377 and project d968da29136f49d5aed98824bfd99ad9. Resources: {'key_pairs'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:30:04 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-3d6f4c93-fa5d-4277-abe2-e2836044b7a7 tempest-TestStampPattern-1749863168 tempest-TestStampPattern-1749863168-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.422240 Apr 18 14:30:04 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 35/101] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:30:04 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:30:04 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1089634820", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "networks": [{"uuid": "16d9d915-1511-40be-b89a-45839db8d12c"}]}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] validate_networks() for [('16d9d915-1511-40be-b89a-45839db8d12c', None, None, None, None, None)] {{(pid=61309) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Flavor limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Image limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Flavor pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Image pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Getting quotas for project d819b77200604437b32f3f6037b31b93. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Getting quotas for user b2a910fffabb433b9378b8a3e487bbd4 and project d819b77200604437b32f3f6037b31b93. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Going to run 1 instances... {{(pid=61309) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:30:05 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] [instance: 0942f138-80f9-44d8-acc5-56e60098b8e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61309) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:30:05 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-29ecd645-2e1f-4573-b9d0-3d8707812c90 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.772405 Apr 18 14:30:05 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 34/102] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:30:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:30:05 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-c4c78d60-bd03-4782-80a4-a58721389dc5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:30:05 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-c4c78d60-bd03-4782-80a4-a58721389dc5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] [instance: 0942f138-80f9-44d8-acc5-56e60098b8e9] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:30:05 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-c4c78d60-bd03-4782-80a4-a58721389dc5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a910fffabb433b9378b8a3e487bbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd819b77200604437b32f3f6037b31b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:30:05 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-c4c78d60-bd03-4782-80a4-a58721389dc5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0942f138-80f9-44d8-acc5-56e60098b8e9" status: 200 len: 1208 microversion: 2.1 time: 0.065948 Apr 18 14:30:05 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 34/103] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:30:05 2023] GET /compute/v2.1/servers/0942f138-80f9-44d8-acc5-56e60098b8e9 => generated 1208 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:30:08 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=5 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-7fd50856-ec8a-4b8e-ade1-507dc180130b tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:30:08 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-7fd50856-ec8a-4b8e-ade1-507dc180130b tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 6dcffb71-055a-4ae6-bf65-df885c035e5a] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:30:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-7fd50856-ec8a-4b8e-ade1-507dc180130b tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-7fd50856-ec8a-4b8e-ade1-507dc180130b tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-7fd50856-ec8a-4b8e-ade1-507dc180130b tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-7fd50856-ec8a-4b8e-ade1-507dc180130b tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-7fd50856-ec8a-4b8e-ade1-507dc180130b tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-7fd50856-ec8a-4b8e-ade1-507dc180130b tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:08 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-8a8a57a5-bd91-497e-a4d9-5b50992e5a29 tempest-TestStampPattern-1749863168 tempest-TestStampPattern-1749863168-project-member] Calling method '.version_select at 0x7f5ceeb91d80>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:30:08 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=7 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:08 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-8a8a57a5-bd91-497e-a4d9-5b50992e5a29 tempest-TestStampPattern-1749863168 tempest-TestStampPattern-1749863168-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1346172718" status: 202 len: 0 microversion: 2.1 time: 0.030084 Apr 18 14:30:08 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 35/104] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 14:30:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1346172718 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:30:09 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-7fd50856-ec8a-4b8e-ade1-507dc180130b tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b9b392cafe4b58b429be8e010baa08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88dd648f400c48f384c828c3933baa5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:30:09 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-7fd50856-ec8a-4b8e-ade1-507dc180130b tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a" status: 200 len: 1535 microversion: 2.1 time: 0.987632 Apr 18 14:30:09 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 36/105] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:30:08 2023] GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a => generated 1535 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:30:09 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-648ded2a-333e-4229-9270-facb6ff80663 req-160d4861-d243-4662-b5ba-14b4c810e3eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0942f138-80f9-44d8-acc5-56e60098b8e9", "tag": "9859adab-a035-4e60-89d0-0d5749ad5fa1"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:30:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-648ded2a-333e-4229-9270-facb6ff80663 req-160d4861-d243-4662-b5ba-14b4c810e3eb service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-648ded2a-333e-4229-9270-facb6ff80663 req-160d4861-d243-4662-b5ba-14b4c810e3eb service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-648ded2a-333e-4229-9270-facb6ff80663 req-160d4861-d243-4662-b5ba-14b4c810e3eb service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:09 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-648ded2a-333e-4229-9270-facb6ff80663 req-160d4861-d243-4662-b5ba-14b4c810e3eb service nova] Creating event network-changed:9859adab-a035-4e60-89d0-0d5749ad5fa1 for instance 0942f138-80f9-44d8-acc5-56e60098b8e9 on user Apr 18 14:30:09 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-648ded2a-333e-4229-9270-facb6ff80663 req-160d4861-d243-4662-b5ba-14b4c810e3eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030143 Apr 18 14:30:09 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 35/106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:30:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 14:30:12 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-aa8e4c73-de33-473d-b337-262c6e696314 req-e000a8fb-2097-4e53-9fa7-09cdcd647f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0942f138-80f9-44d8-acc5-56e60098b8e9", "name": "network-vif-plugged", "status": "completed", "tag": "9859adab-a035-4e60-89d0-0d5749ad5fa1"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:30:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-aa8e4c73-de33-473d-b337-262c6e696314 req-e000a8fb-2097-4e53-9fa7-09cdcd647f5c service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-aa8e4c73-de33-473d-b337-262c6e696314 req-e000a8fb-2097-4e53-9fa7-09cdcd647f5c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-aa8e4c73-de33-473d-b337-262c6e696314 req-e000a8fb-2097-4e53-9fa7-09cdcd647f5c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:12 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-aa8e4c73-de33-473d-b337-262c6e696314 req-e000a8fb-2097-4e53-9fa7-09cdcd647f5c service nova] Creating event network-vif-plugged:9859adab-a035-4e60-89d0-0d5749ad5fa1 for instance 0942f138-80f9-44d8-acc5-56e60098b8e9 on user Apr 18 14:30:12 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-aa8e4c73-de33-473d-b337-262c6e696314 req-e000a8fb-2097-4e53-9fa7-09cdcd647f5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031659 Apr 18 14:30:12 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 36/107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:30:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:30:13 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-85cb7230-42c4-434d-be25-99795284d84c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:30:13 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-85cb7230-42c4-434d-be25-99795284d84c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:30:13 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-85cb7230-42c4-434d-be25-99795284d84c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-85cb7230-42c4-434d-be25-99795284d84c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-85cb7230-42c4-434d-be25-99795284d84c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-85cb7230-42c4-434d-be25-99795284d84c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-85cb7230-42c4-434d-be25-99795284d84c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-85cb7230-42c4-434d-be25-99795284d84c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:14 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-85cb7230-42c4-434d-be25-99795284d84c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:30:14 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-85cb7230-42c4-434d-be25-99795284d84c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1538 microversion: 2.1 time: 0.624187 Apr 18 14:30:14 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 37/108] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:30:13 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1538 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:30:14 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-3ef31621-86f0-4eec-ba85-ba6adc1866a0 req-cefae33e-5573-4e0f-b231-616f3eedb982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0942f138-80f9-44d8-acc5-56e60098b8e9", "name": "network-vif-plugged", "status": "completed", "tag": "9859adab-a035-4e60-89d0-0d5749ad5fa1"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:30:14 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-3ef31621-86f0-4eec-ba85-ba6adc1866a0 req-cefae33e-5573-4e0f-b231-616f3eedb982 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-3ef31621-86f0-4eec-ba85-ba6adc1866a0 req-cefae33e-5573-4e0f-b231-616f3eedb982 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-3ef31621-86f0-4eec-ba85-ba6adc1866a0 req-cefae33e-5573-4e0f-b231-616f3eedb982 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:14 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-3ef31621-86f0-4eec-ba85-ba6adc1866a0 req-cefae33e-5573-4e0f-b231-616f3eedb982 service nova] Creating event network-vif-plugged:9859adab-a035-4e60-89d0-0d5749ad5fa1 for instance 0942f138-80f9-44d8-acc5-56e60098b8e9 on user Apr 18 14:30:14 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-3ef31621-86f0-4eec-ba85-ba6adc1866a0 req-cefae33e-5573-4e0f-b231-616f3eedb982 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039268 Apr 18 14:30:14 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 36/109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:30:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=14 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-b28f5fcc-5565-4213-8161-90889cd09ebc tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-b28f5fcc-5565-4213-8161-90889cd09ebc tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 6d6793c2-2b28-4337-baf2-9fd9b4e70a36] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b28f5fcc-5565-4213-8161-90889cd09ebc tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b28f5fcc-5565-4213-8161-90889cd09ebc tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b28f5fcc-5565-4213-8161-90889cd09ebc tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b28f5fcc-5565-4213-8161-90889cd09ebc tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b28f5fcc-5565-4213-8161-90889cd09ebc tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b28f5fcc-5565-4213-8161-90889cd09ebc tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:35 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-b28f5fcc-5565-4213-8161-90889cd09ebc tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039b3016f884a42abcb58054d649cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1e17fb95d64cae9c6c210d143d115b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:30:35 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-b28f5fcc-5565-4213-8161-90889cd09ebc tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36" status: 200 len: 1543 microversion: 2.1 time: 0.224631 Apr 18 14:30:35 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 37/110] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:30:35 2023] GET /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36 => generated 1543 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 14:30:36 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-60499330-c1a9-47e6-8653-d451ae98ab0d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Action: 'create', calling method: .version_select at 0x7f5ceec6e3b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1401672297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoyMuzdDyiG7Y0yxMIKQSc/kHBDbYOKXcLcCqeGYa5/X5lWC7R2tfYRgejGrAjMTe47zc4EoyO+Q5P/BZJekY3jkSc5W3Ub0RhIRUSDQsOOKPNZ1vGG4j927M/E68WLEA=="}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:30:36 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:36 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:36 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=12 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:36 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-60499330-c1a9-47e6-8653-d451ae98ab0d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Getting quotas for project 37b30ff7e42a496fa0abfb7102e9c0b8. Resources: {'key_pairs'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:30:36 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-60499330-c1a9-47e6-8653-d451ae98ab0d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Getting quotas for user 6ae2d60ff00f4be59827e15aece5d8c4 and project 37b30ff7e42a496fa0abfb7102e9c0b8. Resources: {'key_pairs'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:30:36 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-60499330-c1a9-47e6-8653-d451ae98ab0d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051634 Apr 18 14:30:36 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 38/111] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:30:36 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:30:36 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:36 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:36 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=14 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:36 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1446900491", "imageRef": "32214c53-3ceb-4468-bfc5-21ef3b7ffdba", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1401672297", "networks": [{"uuid": "15f69a51-bdb4-419b-ab40-87648b533468"}]}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:30:36 user devstack@n-api.service[61311]: DEBUG nova.network.neutron [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] validate_networks() for [('15f69a51-bdb4-419b-ab40-87648b533468', None, None, None, None, None)] {{(pid=61311) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Flavor limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Image limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Flavor pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Image pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Getting quotas for project 37b30ff7e42a496fa0abfb7102e9c0b8. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Getting quotas for user 6ae2d60ff00f4be59827e15aece5d8c4 and project 37b30ff7e42a496fa0abfb7102e9c0b8. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Going to run 1 instances... {{(pid=61311) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:30:37 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: 2bee7710-8a40-47bc-89b7-f0cf4def19b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='32214c53-3ceb-4468-bfc5-21ef3b7ffdba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:30:37 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-617aa23f-a69c-4a12-8167-3d610ed744ca tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.643660 Apr 18 14:30:37 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 37/112] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:30:36 2023] POST /compute/v2.1/servers => generated 378 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:30:37 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-b44677e2-d33d-4577-a0ea-7a0d4c20346e tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:30:37 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-b44677e2-d33d-4577-a0ea-7a0d4c20346e tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: 2bee7710-8a40-47bc-89b7-f0cf4def19b3] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:30:37 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-b44677e2-d33d-4577-a0ea-7a0d4c20346e tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae2d60ff00f4be59827e15aece5d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:30:37 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-b44677e2-d33d-4577-a0ea-7a0d4c20346e tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3" status: 200 len: 1253 microversion: 2.1 time: 0.085570 Apr 18 14:30:37 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 38/113] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:30:37 2023] GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3 => generated 1253 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:30:37 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-155ce677-e269-448e-8bf0-39b37c88aa72 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:30:37 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-155ce677-e269-448e-8bf0-39b37c88aa72 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] [instance: 51b6bf0a-d424-43fe-b5fd-3a6843bb1672] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:30:37 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-155ce677-e269-448e-8bf0-39b37c88aa72 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:37 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-155ce677-e269-448e-8bf0-39b37c88aa72 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:37 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-155ce677-e269-448e-8bf0-39b37c88aa72 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:37 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-155ce677-e269-448e-8bf0-39b37c88aa72 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:37 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-155ce677-e269-448e-8bf0-39b37c88aa72 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:37 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-155ce677-e269-448e-8bf0-39b37c88aa72 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:37 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-155ce677-e269-448e-8bf0-39b37c88aa72 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b50d25047934c9fad65b69209730a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb471110565402aa21064786951ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:30:37 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-155ce677-e269-448e-8bf0-39b37c88aa72 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672" status: 200 len: 1549 microversion: 2.1 time: 0.226858 Apr 18 14:30:37 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 39/114] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:30:37 2023] GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672 => generated 1549 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:30:40 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-4b8cd89f-2821-49a9-8be6-e24818b58564 req-a92ec383-3dd4-4a71-8cd3-8e257b833bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bee7710-8a40-47bc-89b7-f0cf4def19b3", "tag": "6a56aa1a-ddbb-4d13-bc54-cdb64c02282f"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:30:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-4b8cd89f-2821-49a9-8be6-e24818b58564 req-a92ec383-3dd4-4a71-8cd3-8e257b833bbf service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-4b8cd89f-2821-49a9-8be6-e24818b58564 req-a92ec383-3dd4-4a71-8cd3-8e257b833bbf service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-4b8cd89f-2821-49a9-8be6-e24818b58564 req-a92ec383-3dd4-4a71-8cd3-8e257b833bbf service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:40 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-4b8cd89f-2821-49a9-8be6-e24818b58564 req-a92ec383-3dd4-4a71-8cd3-8e257b833bbf service nova] Creating event network-changed:6a56aa1a-ddbb-4d13-bc54-cdb64c02282f for instance 2bee7710-8a40-47bc-89b7-f0cf4def19b3 on user Apr 18 14:30:40 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-4b8cd89f-2821-49a9-8be6-e24818b58564 req-a92ec383-3dd4-4a71-8cd3-8e257b833bbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037055 Apr 18 14:30:40 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 38/115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:30:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:30:42 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-d723647d-35a9-45db-9e87-26941e39624e req-97273013-70fc-4f3d-b2c0-4a835d4d38f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bee7710-8a40-47bc-89b7-f0cf4def19b3", "name": "network-vif-plugged", "status": "completed", "tag": "6a56aa1a-ddbb-4d13-bc54-cdb64c02282f"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:30:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-d723647d-35a9-45db-9e87-26941e39624e req-97273013-70fc-4f3d-b2c0-4a835d4d38f0 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-d723647d-35a9-45db-9e87-26941e39624e req-97273013-70fc-4f3d-b2c0-4a835d4d38f0 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-d723647d-35a9-45db-9e87-26941e39624e req-97273013-70fc-4f3d-b2c0-4a835d4d38f0 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:42 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-d723647d-35a9-45db-9e87-26941e39624e req-97273013-70fc-4f3d-b2c0-4a835d4d38f0 service nova] Creating event network-vif-plugged:6a56aa1a-ddbb-4d13-bc54-cdb64c02282f for instance 2bee7710-8a40-47bc-89b7-f0cf4def19b3 on user Apr 18 14:30:42 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-d723647d-35a9-45db-9e87-26941e39624e req-97273013-70fc-4f3d-b2c0-4a835d4d38f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047417 Apr 18 14:30:42 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 39/116] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:30:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:30:44 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-6ae5e245-20b7-452a-9781-3c0756ab3d39 req-f9b3578d-4245-486c-973c-88ff32b109fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bee7710-8a40-47bc-89b7-f0cf4def19b3", "name": "network-vif-plugged", "status": "completed", "tag": "6a56aa1a-ddbb-4d13-bc54-cdb64c02282f"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:30:44 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-6ae5e245-20b7-452a-9781-3c0756ab3d39 req-f9b3578d-4245-486c-973c-88ff32b109fd service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:44 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-6ae5e245-20b7-452a-9781-3c0756ab3d39 req-f9b3578d-4245-486c-973c-88ff32b109fd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:44 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-6ae5e245-20b7-452a-9781-3c0756ab3d39 req-f9b3578d-4245-486c-973c-88ff32b109fd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:44 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-6ae5e245-20b7-452a-9781-3c0756ab3d39 req-f9b3578d-4245-486c-973c-88ff32b109fd service nova] Creating event network-vif-plugged:6a56aa1a-ddbb-4d13-bc54-cdb64c02282f for instance 2bee7710-8a40-47bc-89b7-f0cf4def19b3 on user Apr 18 14:30:44 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-6ae5e245-20b7-452a-9781-3c0756ab3d39 req-f9b3578d-4245-486c-973c-88ff32b109fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029246 Apr 18 14:30:44 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 40/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:30:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:30:55 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:55 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:55 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:55 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:30:55 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-c38e5d2f-4918-4c26-855a-7eb1bcf8e8fa tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:30:55 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-c38e5d2f-4918-4c26-855a-7eb1bcf8e8fa tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] [instance: 0942f138-80f9-44d8-acc5-56e60098b8e9] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:30:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c38e5d2f-4918-4c26-855a-7eb1bcf8e8fa tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c38e5d2f-4918-4c26-855a-7eb1bcf8e8fa tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c38e5d2f-4918-4c26-855a-7eb1bcf8e8fa tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c38e5d2f-4918-4c26-855a-7eb1bcf8e8fa tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:30:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c38e5d2f-4918-4c26-855a-7eb1bcf8e8fa tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:30:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c38e5d2f-4918-4c26-855a-7eb1bcf8e8fa tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:30:56 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-c38e5d2f-4918-4c26-855a-7eb1bcf8e8fa tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a910fffabb433b9378b8a3e487bbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd819b77200604437b32f3f6037b31b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:30:56 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-c38e5d2f-4918-4c26-855a-7eb1bcf8e8fa tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0942f138-80f9-44d8-acc5-56e60098b8e9" status: 200 len: 1486 microversion: 2.1 time: 0.296526 Apr 18 14:30:56 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 39/118] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:30:55 2023] GET /compute/v2.1/servers/0942f138-80f9-44d8-acc5-56e60098b8e9 => generated 1486 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:31:01 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:01 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=8 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:01 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=8 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:01 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-cf834d17-6041-4004-9903-17cf148795b1 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:01 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-cf834d17-6041-4004-9903-17cf148795b1 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 909db006-c38d-4b50-acaa-4224aed6ea45] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cf834d17-6041-4004-9903-17cf148795b1 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cf834d17-6041-4004-9903-17cf148795b1 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cf834d17-6041-4004-9903-17cf148795b1 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cf834d17-6041-4004-9903-17cf148795b1 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cf834d17-6041-4004-9903-17cf148795b1 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cf834d17-6041-4004-9903-17cf148795b1 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:01 user devstack@n-api.service[61309]: DEBUG nova.objects.instance [None req-cf834d17-6041-4004-9903-17cf148795b1 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lazy-loading 'flavor' on Instance uuid 909db006-c38d-4b50-acaa-4224aed6ea45 {{(pid=61309) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 14:31:02 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-cf834d17-6041-4004-9903-17cf148795b1 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "POST /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45/action" status: 200 len: 32 microversion: 2.1 time: 0.194639 Apr 18 14:31:02 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 40/119] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 14:31:01 2023] POST /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 18 14:31:02 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:02 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:02 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=8 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:02 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-1eed25a1-42f5-4dfd-baba-44687144f1bd tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:02 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-1eed25a1-42f5-4dfd-baba-44687144f1bd tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 909db006-c38d-4b50-acaa-4224aed6ea45] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:02 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-1eed25a1-42f5-4dfd-baba-44687144f1bd tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:02 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-1eed25a1-42f5-4dfd-baba-44687144f1bd tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:02 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-1eed25a1-42f5-4dfd-baba-44687144f1bd tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:02 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-1eed25a1-42f5-4dfd-baba-44687144f1bd tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:02 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-1eed25a1-42f5-4dfd-baba-44687144f1bd tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:02 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-1eed25a1-42f5-4dfd-baba-44687144f1bd tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:02 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-1eed25a1-42f5-4dfd-baba-44687144f1bd tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e284b794c4043768af56fd58fceb837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ca11d8beec4410a8a4c8ae7c8e4bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:31:02 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-1eed25a1-42f5-4dfd-baba-44687144f1bd tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45" status: 200 len: 1508 microversion: 2.1 time: 0.372815 Apr 18 14:31:02 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 41/120] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:31:02 2023] GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45 => generated 1508 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:31:02 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-12987987-29ef-49f1-9cce-11c7d56e8194 req-42f8facb-d735-4c73-b0b4-1aaca17a29a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909db006-c38d-4b50-acaa-4224aed6ea45", "name": "network-vif-unplugged", "status": "completed", "tag": "f4b085c8-1069-40a4-8d8b-ebb5633472a6"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:02 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-12987987-29ef-49f1-9cce-11c7d56e8194 req-42f8facb-d735-4c73-b0b4-1aaca17a29a3 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:02 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-12987987-29ef-49f1-9cce-11c7d56e8194 req-42f8facb-d735-4c73-b0b4-1aaca17a29a3 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:02 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-12987987-29ef-49f1-9cce-11c7d56e8194 req-42f8facb-d735-4c73-b0b4-1aaca17a29a3 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:02 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-12987987-29ef-49f1-9cce-11c7d56e8194 req-42f8facb-d735-4c73-b0b4-1aaca17a29a3 service nova] Creating event network-vif-unplugged:f4b085c8-1069-40a4-8d8b-ebb5633472a6 for instance 909db006-c38d-4b50-acaa-4224aed6ea45 on user Apr 18 14:31:02 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-12987987-29ef-49f1-9cce-11c7d56e8194 req-42f8facb-d735-4c73-b0b4-1aaca17a29a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029641 Apr 18 14:31:02 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:03 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1626417118", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "networks": [{"uuid": "7de7c9c8-6753-4201-a6c7-ffa00da6c3ee"}]}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:03 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] validate_networks() for [('7de7c9c8-6753-4201-a6c7-ffa00da6c3ee', None, None, None, None, None)] {{(pid=61309) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Flavor limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Image limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Flavor pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Image pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Getting quotas for project 3312c2b6e41142799cb66dd1377558d8. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Getting quotas for user b209357fca7f40c0b52507a285e054e3 and project 3312c2b6e41142799cb66dd1377558d8. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Going to run 1 instances... {{(pid=61309) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:31:04 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: 1b25948f-1d8c-4058-b3ed-8dca864de019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61309) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:31:04 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-5dddd01b-91dd-46cc-895d-70265c8f0a61 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.987655 Apr 18 14:31:04 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 41/122] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:31:03 2023] POST /compute/v2.1/servers => generated 378 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:31:04 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-ef85151f-2407-4274-b56b-50618d823ed4 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:04 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-ef85151f-2407-4274-b56b-50618d823ed4 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: 1b25948f-1d8c-4058-b3ed-8dca864de019] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:04 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-ef85151f-2407-4274-b56b-50618d823ed4 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b209357fca7f40c0b52507a285e054e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312c2b6e41142799cb66dd1377558d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:31:04 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-ef85151f-2407-4274-b56b-50618d823ed4 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019" status: 200 len: 1211 microversion: 2.1 time: 0.109961 Apr 18 14:31:04 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 42/123] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:31:04 2023] GET /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019 => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:31:05 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-e585dba4-0e32-459d-b2ab-25e4b11a4393 req-13337921-c2e0-45a1-9fa4-d43ffde3f347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909db006-c38d-4b50-acaa-4224aed6ea45", "name": "network-vif-plugged", "status": "completed", "tag": "f4b085c8-1069-40a4-8d8b-ebb5633472a6"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:05 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-e585dba4-0e32-459d-b2ab-25e4b11a4393 req-13337921-c2e0-45a1-9fa4-d43ffde3f347 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:05 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-e585dba4-0e32-459d-b2ab-25e4b11a4393 req-13337921-c2e0-45a1-9fa4-d43ffde3f347 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:05 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-e585dba4-0e32-459d-b2ab-25e4b11a4393 req-13337921-c2e0-45a1-9fa4-d43ffde3f347 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:05 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-e585dba4-0e32-459d-b2ab-25e4b11a4393 req-13337921-c2e0-45a1-9fa4-d43ffde3f347 service nova] Creating event network-vif-plugged:f4b085c8-1069-40a4-8d8b-ebb5633472a6 for instance 909db006-c38d-4b50-acaa-4224aed6ea45 on user Apr 18 14:31:05 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-e585dba4-0e32-459d-b2ab-25e4b11a4393 req-13337921-c2e0-45a1-9fa4-d43ffde3f347 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029899 Apr 18 14:31:05 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:06 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-8aadafa8-e772-4e74-a948-8e44f7176a3c req-ff61c400-fe95-47f3-bd43-8eedd4d29a15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b25948f-1d8c-4058-b3ed-8dca864de019", "tag": "867014ca-c57c-49c8-ae22-275899767873"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:06 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8aadafa8-e772-4e74-a948-8e44f7176a3c req-ff61c400-fe95-47f3-bd43-8eedd4d29a15 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:06 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8aadafa8-e772-4e74-a948-8e44f7176a3c req-ff61c400-fe95-47f3-bd43-8eedd4d29a15 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:06 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8aadafa8-e772-4e74-a948-8e44f7176a3c req-ff61c400-fe95-47f3-bd43-8eedd4d29a15 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:06 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-8aadafa8-e772-4e74-a948-8e44f7176a3c req-ff61c400-fe95-47f3-bd43-8eedd4d29a15 service nova] Creating event network-changed:867014ca-c57c-49c8-ae22-275899767873 for instance 1b25948f-1d8c-4058-b3ed-8dca864de019 on user Apr 18 14:31:06 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-8aadafa8-e772-4e74-a948-8e44f7176a3c req-ff61c400-fe95-47f3-bd43-8eedd4d29a15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031995 Apr 18 14:31:06 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 42/125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:07 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-c72c9648-8321-495f-a87a-7cfd00d4f0dc req-53667793-c6fc-4a93-bfaf-444d56502095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909db006-c38d-4b50-acaa-4224aed6ea45", "name": "network-vif-plugged", "status": "completed", "tag": "f4b085c8-1069-40a4-8d8b-ebb5633472a6"}, {"server_uuid": "909db006-c38d-4b50-acaa-4224aed6ea45", "name": "network-vif-plugged", "status": "completed", "tag": "f4b085c8-1069-40a4-8d8b-ebb5633472a6"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:07 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-c72c9648-8321-495f-a87a-7cfd00d4f0dc req-53667793-c6fc-4a93-bfaf-444d56502095 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:07 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-c72c9648-8321-495f-a87a-7cfd00d4f0dc req-53667793-c6fc-4a93-bfaf-444d56502095 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:07 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-c72c9648-8321-495f-a87a-7cfd00d4f0dc req-53667793-c6fc-4a93-bfaf-444d56502095 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:07 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-c72c9648-8321-495f-a87a-7cfd00d4f0dc req-53667793-c6fc-4a93-bfaf-444d56502095 service nova] Creating event network-vif-plugged:f4b085c8-1069-40a4-8d8b-ebb5633472a6 for instance 909db006-c38d-4b50-acaa-4224aed6ea45 on user Apr 18 14:31:07 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-c72c9648-8321-495f-a87a-7cfd00d4f0dc req-53667793-c6fc-4a93-bfaf-444d56502095 service nova] Creating event network-vif-plugged:f4b085c8-1069-40a4-8d8b-ebb5633472a6 for instance 909db006-c38d-4b50-acaa-4224aed6ea45 on user Apr 18 14:31:07 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-c72c9648-8321-495f-a87a-7cfd00d4f0dc req-53667793-c6fc-4a93-bfaf-444d56502095 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035473 Apr 18 14:31:07 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 43/126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:09 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ab7aec10-835b-447e-9dab-760a5c6a5223 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:09 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-ab7aec10-835b-447e-9dab-760a5c6a5223 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 6dcffb71-055a-4ae6-bf65-df885c035e5a] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ab7aec10-835b-447e-9dab-760a5c6a5223 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ab7aec10-835b-447e-9dab-760a5c6a5223 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ab7aec10-835b-447e-9dab-760a5c6a5223 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ab7aec10-835b-447e-9dab-760a5c6a5223 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ab7aec10-835b-447e-9dab-760a5c6a5223 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ab7aec10-835b-447e-9dab-760a5c6a5223 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:09 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-0c56d7c1-b69b-48b1-902e-2866aa779a74 req-3f981437-c064-477b-8bca-5b9e22d0bac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b25948f-1d8c-4058-b3ed-8dca864de019", "name": "network-vif-plugged", "status": "completed", "tag": "867014ca-c57c-49c8-ae22-275899767873"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:09 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0c56d7c1-b69b-48b1-902e-2866aa779a74 req-3f981437-c064-477b-8bca-5b9e22d0bac7 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:09 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0c56d7c1-b69b-48b1-902e-2866aa779a74 req-3f981437-c064-477b-8bca-5b9e22d0bac7 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:09 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0c56d7c1-b69b-48b1-902e-2866aa779a74 req-3f981437-c064-477b-8bca-5b9e22d0bac7 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:09 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-0c56d7c1-b69b-48b1-902e-2866aa779a74 req-3f981437-c064-477b-8bca-5b9e22d0bac7 service nova] Creating event network-vif-plugged:867014ca-c57c-49c8-ae22-275899767873 for instance 1b25948f-1d8c-4058-b3ed-8dca864de019 on user Apr 18 14:31:09 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-0c56d7c1-b69b-48b1-902e-2866aa779a74 req-3f981437-c064-477b-8bca-5b9e22d0bac7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033531 Apr 18 14:31:09 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 43/127] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:09 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ab7aec10-835b-447e-9dab-760a5c6a5223 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.297433 Apr 18 14:31:09 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 42/128] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 14:31:09 2023] GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a/os-interface => generated 282 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:11 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-ea3ff805-6369-47de-a306-0638464929fc tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:11 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-ea3ff805-6369-47de-a306-0638464929fc tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 6dcffb71-055a-4ae6-bf65-df885c035e5a] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-ea3ff805-6369-47de-a306-0638464929fc tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-ea3ff805-6369-47de-a306-0638464929fc tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-ea3ff805-6369-47de-a306-0638464929fc tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-ea3ff805-6369-47de-a306-0638464929fc tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-ea3ff805-6369-47de-a306-0638464929fc tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-ea3ff805-6369-47de-a306-0638464929fc tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:11 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-ea3ff805-6369-47de-a306-0638464929fc tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a/ips" status: 200 len: 103 microversion: 2.1 time: 0.071813 Apr 18 14:31:11 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 44/129] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 14:31:11 2023] GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a/ips => generated 103 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:11 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-fee1aac2-75b2-4b27-a526-5671c2af4eed req-11097039-456a-4d0b-b1a0-9f670f5fc428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b25948f-1d8c-4058-b3ed-8dca864de019", "name": "network-vif-plugged", "status": "completed", "tag": "867014ca-c57c-49c8-ae22-275899767873"}, {"name": "network-changed", "server_uuid": "6dcffb71-055a-4ae6-bf65-df885c035e5a", "tag": "598909ff-6d80-4f39-91d5-a53ca08f248d"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:11 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-fee1aac2-75b2-4b27-a526-5671c2af4eed req-11097039-456a-4d0b-b1a0-9f670f5fc428 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:11 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-fee1aac2-75b2-4b27-a526-5671c2af4eed req-11097039-456a-4d0b-b1a0-9f670f5fc428 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:11 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-fee1aac2-75b2-4b27-a526-5671c2af4eed req-11097039-456a-4d0b-b1a0-9f670f5fc428 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:11 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-fee1aac2-75b2-4b27-a526-5671c2af4eed req-11097039-456a-4d0b-b1a0-9f670f5fc428 service nova] Creating event network-vif-plugged:867014ca-c57c-49c8-ae22-275899767873 for instance 1b25948f-1d8c-4058-b3ed-8dca864de019 on user Apr 18 14:31:11 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-fee1aac2-75b2-4b27-a526-5671c2af4eed req-11097039-456a-4d0b-b1a0-9f670f5fc428 service nova] Creating event network-changed:598909ff-6d80-4f39-91d5-a53ca08f248d for instance 6dcffb71-055a-4ae6-bf65-df885c035e5a on user Apr 18 14:31:11 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-fee1aac2-75b2-4b27-a526-5671c2af4eed req-11097039-456a-4d0b-b1a0-9f670f5fc428 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035763 Apr 18 14:31:11 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 44/130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:11 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:12 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-639830ca-4f7d-4e66-8b1e-3739a124f7a0 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:12 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-639830ca-4f7d-4e66-8b1e-3739a124f7a0 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 6dcffb71-055a-4ae6-bf65-df885c035e5a] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:12 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-639830ca-4f7d-4e66-8b1e-3739a124f7a0 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:12 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-639830ca-4f7d-4e66-8b1e-3739a124f7a0 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:12 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-639830ca-4f7d-4e66-8b1e-3739a124f7a0 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:12 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-639830ca-4f7d-4e66-8b1e-3739a124f7a0 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:12 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-639830ca-4f7d-4e66-8b1e-3739a124f7a0 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:12 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-639830ca-4f7d-4e66-8b1e-3739a124f7a0 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:12 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-639830ca-4f7d-4e66-8b1e-3739a124f7a0 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 6dcffb71-055a-4ae6-bf65-df885c035e5a] Going to try to terminate instance {{(pid=61311) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:31:12 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-639830ca-4f7d-4e66-8b1e-3739a124f7a0 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a" status: 204 len: 0 microversion: 2.1 time: 0.141494 Apr 18 14:31:12 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 43/131] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:31:12 2023] DELETE /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:31:12 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-8dd8558c-b486-4e1e-8ed4-876536bb7282 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:12 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-8dd8558c-b486-4e1e-8ed4-876536bb7282 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 6dcffb71-055a-4ae6-bf65-df885c035e5a] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:12 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8dd8558c-b486-4e1e-8ed4-876536bb7282 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:12 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8dd8558c-b486-4e1e-8ed4-876536bb7282 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:12 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8dd8558c-b486-4e1e-8ed4-876536bb7282 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:12 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8dd8558c-b486-4e1e-8ed4-876536bb7282 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:12 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8dd8558c-b486-4e1e-8ed4-876536bb7282 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:12 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8dd8558c-b486-4e1e-8ed4-876536bb7282 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:13 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-8dd8558c-b486-4e1e-8ed4-876536bb7282 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b9b392cafe4b58b429be8e010baa08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88dd648f400c48f384c828c3933baa5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:31:13 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-8dd8558c-b486-4e1e-8ed4-876536bb7282 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a" status: 200 len: 1660 microversion: 2.1 time: 0.302181 Apr 18 14:31:13 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 45/132] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:31:12 2023] GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a => generated 1660 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:31:13 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-efff888e-a15f-44a2-8035-cba21022c27c req-4ab22ebd-a47f-4f8b-a284-e9213c875a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcffb71-055a-4ae6-bf65-df885c035e5a", "name": "network-vif-unplugged", "status": "completed", "tag": "598909ff-6d80-4f39-91d5-a53ca08f248d"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:13 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-efff888e-a15f-44a2-8035-cba21022c27c req-4ab22ebd-a47f-4f8b-a284-e9213c875a80 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:13 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-efff888e-a15f-44a2-8035-cba21022c27c req-4ab22ebd-a47f-4f8b-a284-e9213c875a80 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:13 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-efff888e-a15f-44a2-8035-cba21022c27c req-4ab22ebd-a47f-4f8b-a284-e9213c875a80 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:13 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-efff888e-a15f-44a2-8035-cba21022c27c req-4ab22ebd-a47f-4f8b-a284-e9213c875a80 service nova] Creating event network-vif-unplugged:598909ff-6d80-4f39-91d5-a53ca08f248d for instance 6dcffb71-055a-4ae6-bf65-df885c035e5a on user Apr 18 14:31:13 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-efff888e-a15f-44a2-8035-cba21022c27c req-4ab22ebd-a47f-4f8b-a284-e9213c875a80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049817 Apr 18 14:31:13 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 45/133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:14 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ca1a9bda-c23c-4259-95a7-bd2225e0e47c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:14 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-ca1a9bda-c23c-4259-95a7-bd2225e0e47c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ca1a9bda-c23c-4259-95a7-bd2225e0e47c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ca1a9bda-c23c-4259-95a7-bd2225e0e47c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ca1a9bda-c23c-4259-95a7-bd2225e0e47c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ca1a9bda-c23c-4259-95a7-bd2225e0e47c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ca1a9bda-c23c-4259-95a7-bd2225e0e47c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ca1a9bda-c23c-4259-95a7-bd2225e0e47c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:14 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ca1a9bda-c23c-4259-95a7-bd2225e0e47c tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.179958 Apr 18 14:31:14 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 44/134] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 14:31:14 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf/os-interface => generated 282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:14 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-dbfce9b1-8574-4d13-af0d-4dcf886f4c1b req-2e7a004a-ff87-44be-9011-88b260238efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcffb71-055a-4ae6-bf65-df885c035e5a", "name": "network-vif-deleted", "tag": "598909ff-6d80-4f39-91d5-a53ca08f248d"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:14 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-dbfce9b1-8574-4d13-af0d-4dcf886f4c1b req-2e7a004a-ff87-44be-9011-88b260238efd service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-dbfce9b1-8574-4d13-af0d-4dcf886f4c1b req-2e7a004a-ff87-44be-9011-88b260238efd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-dbfce9b1-8574-4d13-af0d-4dcf886f4c1b req-2e7a004a-ff87-44be-9011-88b260238efd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:14 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-dbfce9b1-8574-4d13-af0d-4dcf886f4c1b req-2e7a004a-ff87-44be-9011-88b260238efd service nova] Creating event network-vif-deleted:598909ff-6d80-4f39-91d5-a53ca08f248d for instance 6dcffb71-055a-4ae6-bf65-df885c035e5a on user Apr 18 14:31:14 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-dbfce9b1-8574-4d13-af0d-4dcf886f4c1b req-2e7a004a-ff87-44be-9011-88b260238efd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052997 Apr 18 14:31:14 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 46/135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:15 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:15 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:15 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-3d8a1821-dc7f-4c94-a577-694149b1c39e req-e7761dfa-b811-43f9-98b6-208a9b5877cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcffb71-055a-4ae6-bf65-df885c035e5a", "name": "network-vif-plugged", "status": "completed", "tag": "598909ff-6d80-4f39-91d5-a53ca08f248d"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:15 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-3d8a1821-dc7f-4c94-a577-694149b1c39e req-e7761dfa-b811-43f9-98b6-208a9b5877cd service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:15 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-3d8a1821-dc7f-4c94-a577-694149b1c39e req-e7761dfa-b811-43f9-98b6-208a9b5877cd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:15 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-3d8a1821-dc7f-4c94-a577-694149b1c39e req-e7761dfa-b811-43f9-98b6-208a9b5877cd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:15 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-3d8a1821-dc7f-4c94-a577-694149b1c39e req-e7761dfa-b811-43f9-98b6-208a9b5877cd service nova] Creating event network-vif-plugged:598909ff-6d80-4f39-91d5-a53ca08f248d for instance 6dcffb71-055a-4ae6-bf65-df885c035e5a on user Apr 18 14:31:15 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-3d8a1821-dc7f-4c94-a577-694149b1c39e req-e7761dfa-b811-43f9-98b6-208a9b5877cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036860 Apr 18 14:31:15 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 46/136] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:15 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-33adeb5e-a3d2-494e-9650-678d5d92b597 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:15 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-33adeb5e-a3d2-494e-9650-678d5d92b597 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-33adeb5e-a3d2-494e-9650-678d5d92b597 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-33adeb5e-a3d2-494e-9650-678d5d92b597 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-33adeb5e-a3d2-494e-9650-678d5d92b597 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-33adeb5e-a3d2-494e-9650-678d5d92b597 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-33adeb5e-a3d2-494e-9650-678d5d92b597 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-33adeb5e-a3d2-494e-9650-678d5d92b597 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:15 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-33adeb5e-a3d2-494e-9650-678d5d92b597 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:31:15 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-33adeb5e-a3d2-494e-9650-678d5d92b597 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1538 microversion: 2.1 time: 0.155308 Apr 18 14:31:15 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 45/137] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:31:15 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1538 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:31:15 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-87047e53-0924-438c-8c18-dab7f8f5aa3f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:15 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-87047e53-0924-438c-8c18-dab7f8f5aa3f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-87047e53-0924-438c-8c18-dab7f8f5aa3f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-87047e53-0924-438c-8c18-dab7f8f5aa3f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-87047e53-0924-438c-8c18-dab7f8f5aa3f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-87047e53-0924-438c-8c18-dab7f8f5aa3f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-87047e53-0924-438c-8c18-dab7f8f5aa3f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-87047e53-0924-438c-8c18-dab7f8f5aa3f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:16 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-87047e53-0924-438c-8c18-dab7f8f5aa3f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:31:16 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-87047e53-0924-438c-8c18-dab7f8f5aa3f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1538 microversion: 2.1 time: 0.433142 Apr 18 14:31:16 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 47/138] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:31:15 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1538 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:31:17 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-2a85acee-902c-45ab-a402-38cc1f0d9498 req-6993e866-af9d-425c-8860-2b47950ede55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f7c5ef9-09d6-477f-90a8-e6673f75b2cf", "tag": "08bbe937-9331-46f0-a09e-06ca352d0e25"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:17 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-2a85acee-902c-45ab-a402-38cc1f0d9498 req-6993e866-af9d-425c-8860-2b47950ede55 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:17 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-2a85acee-902c-45ab-a402-38cc1f0d9498 req-6993e866-af9d-425c-8860-2b47950ede55 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:17 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-2a85acee-902c-45ab-a402-38cc1f0d9498 req-6993e866-af9d-425c-8860-2b47950ede55 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:17 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-2a85acee-902c-45ab-a402-38cc1f0d9498 req-6993e866-af9d-425c-8860-2b47950ede55 service nova] Creating event network-changed:08bbe937-9331-46f0-a09e-06ca352d0e25 for instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf on user Apr 18 14:31:17 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-2a85acee-902c-45ab-a402-38cc1f0d9498 req-6993e866-af9d-425c-8860-2b47950ede55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037506 Apr 18 14:31:17 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 47/139] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:27 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-c1c467f0-e92d-4c93-af63-046ccc342f29 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:27 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-c1c467f0-e92d-4c93-af63-046ccc342f29 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: 2bee7710-8a40-47bc-89b7-f0cf4def19b3] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:27 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:27 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:27 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c1c467f0-e92d-4c93-af63-046ccc342f29 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:27 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c1c467f0-e92d-4c93-af63-046ccc342f29 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:27 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c1c467f0-e92d-4c93-af63-046ccc342f29 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:27 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c1c467f0-e92d-4c93-af63-046ccc342f29 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:27 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c1c467f0-e92d-4c93-af63-046ccc342f29 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:27 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c1c467f0-e92d-4c93-af63-046ccc342f29 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:27 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-c1c467f0-e92d-4c93-af63-046ccc342f29 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae2d60ff00f4be59827e15aece5d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:31:27 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-c1c467f0-e92d-4c93-af63-046ccc342f29 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3" status: 200 len: 1537 microversion: 2.1 time: 0.521733 Apr 18 14:31:27 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 46/140] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:31:27 2023] GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3 => generated 1537 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:31:35 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-e7e22b64-ea4c-4af3-a6d7-598a1615a055 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:35 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-e7e22b64-ea4c-4af3-a6d7-598a1615a055 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 6d6793c2-2b28-4337-baf2-9fd9b4e70a36] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:35 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=16 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:35 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=26 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:35 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-e7e22b64-ea4c-4af3-a6d7-598a1615a055 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:35 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-e7e22b64-ea4c-4af3-a6d7-598a1615a055 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:35 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-e7e22b64-ea4c-4af3-a6d7-598a1615a055 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:35 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-e7e22b64-ea4c-4af3-a6d7-598a1615a055 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:35 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-e7e22b64-ea4c-4af3-a6d7-598a1615a055 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:35 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-e7e22b64-ea4c-4af3-a6d7-598a1615a055 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:35 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-e7e22b64-ea4c-4af3-a6d7-598a1615a055 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.163405 Apr 18 14:31:35 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 48/141] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 14:31:35 2023] GET /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36/os-interface => generated 282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:36 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:36 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:36 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-0cdc15e0-22f6-4d35-89de-d30d58b06d2a req-d807ee75-2095-48bd-8d38-598152932261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d6793c2-2b28-4337-baf2-9fd9b4e70a36", "tag": "5d2983d3-2e25-4dfd-9dd0-28dbe2111d62"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:36 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0cdc15e0-22f6-4d35-89de-d30d58b06d2a req-d807ee75-2095-48bd-8d38-598152932261 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:36 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0cdc15e0-22f6-4d35-89de-d30d58b06d2a req-d807ee75-2095-48bd-8d38-598152932261 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:36 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0cdc15e0-22f6-4d35-89de-d30d58b06d2a req-d807ee75-2095-48bd-8d38-598152932261 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:36 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-0cdc15e0-22f6-4d35-89de-d30d58b06d2a req-d807ee75-2095-48bd-8d38-598152932261 service nova] Creating event network-changed:5d2983d3-2e25-4dfd-9dd0-28dbe2111d62 for instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 on user Apr 18 14:31:36 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-0cdc15e0-22f6-4d35-89de-d30d58b06d2a req-d807ee75-2095-48bd-8d38-598152932261 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111613 Apr 18 14:31:36 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 48/142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 14:31:37 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-cddde92d-8f4c-4785-bbff-3989c30354e3 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:37 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-cddde92d-8f4c-4785-bbff-3989c30354e3 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] [instance: 51b6bf0a-d424-43fe-b5fd-3a6843bb1672] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:37 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cddde92d-8f4c-4785-bbff-3989c30354e3 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cddde92d-8f4c-4785-bbff-3989c30354e3 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cddde92d-8f4c-4785-bbff-3989c30354e3 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cddde92d-8f4c-4785-bbff-3989c30354e3 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cddde92d-8f4c-4785-bbff-3989c30354e3 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cddde92d-8f4c-4785-bbff-3989c30354e3 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:37 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-215595290", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "networks": [{"uuid": "8d05425b-4ecd-432b-b6c7-ca9f78114449"}]}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:37 user devstack@n-api.service[61310]: DEBUG nova.network.neutron [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] validate_networks() for [('8d05425b-4ecd-432b-b6c7-ca9f78114449', None, None, None, None, None)] {{(pid=61310) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:31:37 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-cddde92d-8f4c-4785-bbff-3989c30354e3 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.152580 Apr 18 14:31:37 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 47/143] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 14:31:37 2023] GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672/os-interface => generated 283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Flavor limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Image limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Flavor pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Image pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Getting quotas for project 2d1e17fb95d64cae9c6c210d143d115b. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Getting quotas for user 2039b3016f884a42abcb58054d649cee and project 2d1e17fb95d64cae9c6c210d143d115b. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Going to run 1 instances... {{(pid=61310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:31:38 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 38b44765-7b1f-449a-bd4d-99d1df340ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:31:38 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-0e4bd970-49e2-42dc-b480-14f244a5a77d tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.667216 Apr 18 14:31:38 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 49/144] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:31:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:31:38 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-eb7c6306-c45b-468d-8b93-bb517c348092 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:38 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-eb7c6306-c45b-468d-8b93-bb517c348092 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 38b44765-7b1f-449a-bd4d-99d1df340ba4] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:38 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-eb7c6306-c45b-468d-8b93-bb517c348092 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039b3016f884a42abcb58054d649cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1e17fb95d64cae9c6c210d143d115b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:31:38 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-eb7c6306-c45b-468d-8b93-bb517c348092 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38b44765-7b1f-449a-bd4d-99d1df340ba4" status: 200 len: 1211 microversion: 2.1 time: 0.087078 Apr 18 14:31:38 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 49/145] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:31:38 2023] GET /compute/v2.1/servers/38b44765-7b1f-449a-bd4d-99d1df340ba4 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:31:38 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-6490cb6d-0dc6-4210-b9f4-e351f6ff4761 req-9b76cba1-5013-4f75-b0e5-31227cfcd686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b6bf0a-d424-43fe-b5fd-3a6843bb1672", "tag": "9e209b67-100e-4779-abbd-38cfc3b4568a"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:38 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-6490cb6d-0dc6-4210-b9f4-e351f6ff4761 req-9b76cba1-5013-4f75-b0e5-31227cfcd686 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:38 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-6490cb6d-0dc6-4210-b9f4-e351f6ff4761 req-9b76cba1-5013-4f75-b0e5-31227cfcd686 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:38 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-6490cb6d-0dc6-4210-b9f4-e351f6ff4761 req-9b76cba1-5013-4f75-b0e5-31227cfcd686 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:38 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-6490cb6d-0dc6-4210-b9f4-e351f6ff4761 req-9b76cba1-5013-4f75-b0e5-31227cfcd686 service nova] Creating event network-changed:9e209b67-100e-4779-abbd-38cfc3b4568a for instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 on user Apr 18 14:31:38 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-6490cb6d-0dc6-4210-b9f4-e351f6ff4761 req-9b76cba1-5013-4f75-b0e5-31227cfcd686 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032348 Apr 18 14:31:38 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 48/146] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:40 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-83728aa0-c7ce-4052-b26e-7e2e95a3d18e tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:40 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-83728aa0-c7ce-4052-b26e-7e2e95a3d18e tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] [instance: 51b6bf0a-d424-43fe-b5fd-3a6843bb1672] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:40 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-83728aa0-c7ce-4052-b26e-7e2e95a3d18e tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:40 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-83728aa0-c7ce-4052-b26e-7e2e95a3d18e tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:40 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-83728aa0-c7ce-4052-b26e-7e2e95a3d18e tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:40 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-83728aa0-c7ce-4052-b26e-7e2e95a3d18e tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:40 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-83728aa0-c7ce-4052-b26e-7e2e95a3d18e tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:40 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-83728aa0-c7ce-4052-b26e-7e2e95a3d18e tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:40 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-83728aa0-c7ce-4052-b26e-7e2e95a3d18e tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] [instance: 51b6bf0a-d424-43fe-b5fd-3a6843bb1672] Going to try to terminate instance {{(pid=61310) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:31:40 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-83728aa0-c7ce-4052-b26e-7e2e95a3d18e tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672" status: 204 len: 0 microversion: 2.1 time: 0.129087 Apr 18 14:31:40 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 50/147] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:31:40 2023] DELETE /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:31:40 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-98ad9454-16ce-45d3-8872-0fcee9c13a2c tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:40 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-98ad9454-16ce-45d3-8872-0fcee9c13a2c tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] [instance: 51b6bf0a-d424-43fe-b5fd-3a6843bb1672] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:40 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-98ad9454-16ce-45d3-8872-0fcee9c13a2c tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:40 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-98ad9454-16ce-45d3-8872-0fcee9c13a2c tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:40 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-98ad9454-16ce-45d3-8872-0fcee9c13a2c tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:40 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-98ad9454-16ce-45d3-8872-0fcee9c13a2c tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:40 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-98ad9454-16ce-45d3-8872-0fcee9c13a2c tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:40 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-98ad9454-16ce-45d3-8872-0fcee9c13a2c tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:40 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-8c91b0a3-854e-436f-9868-3cd68f5a2cac req-94d6bba9-bbc1-4e66-9aa9-e679cb93c2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b6bf0a-d424-43fe-b5fd-3a6843bb1672", "name": "network-vif-unplugged", "status": "completed", "tag": "9e209b67-100e-4779-abbd-38cfc3b4568a"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-8c91b0a3-854e-436f-9868-3cd68f5a2cac req-94d6bba9-bbc1-4e66-9aa9-e679cb93c2a9 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-8c91b0a3-854e-436f-9868-3cd68f5a2cac req-94d6bba9-bbc1-4e66-9aa9-e679cb93c2a9 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-8c91b0a3-854e-436f-9868-3cd68f5a2cac req-94d6bba9-bbc1-4e66-9aa9-e679cb93c2a9 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:40 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-8c91b0a3-854e-436f-9868-3cd68f5a2cac req-94d6bba9-bbc1-4e66-9aa9-e679cb93c2a9 service nova] Creating event network-vif-unplugged:9e209b67-100e-4779-abbd-38cfc3b4568a for instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 on user Apr 18 14:31:40 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-8c91b0a3-854e-436f-9868-3cd68f5a2cac req-94d6bba9-bbc1-4e66-9aa9-e679cb93c2a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028946 Apr 18 14:31:40 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 49/148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:40 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-98ad9454-16ce-45d3-8872-0fcee9c13a2c tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b50d25047934c9fad65b69209730a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb471110565402aa21064786951ab00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:31:40 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-98ad9454-16ce-45d3-8872-0fcee9c13a2c tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672" status: 200 len: 1674 microversion: 2.1 time: 0.395435 Apr 18 14:31:40 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 50/149] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:31:40 2023] GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672 => generated 1674 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:31:41 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-362cd5e7-e136-4fe8-bc06-80f17c030e4d req-b4c59ee9-7c00-4829-bd03-074709ad50c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38b44765-7b1f-449a-bd4d-99d1df340ba4", "tag": "969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:41 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-362cd5e7-e136-4fe8-bc06-80f17c030e4d req-b4c59ee9-7c00-4829-bd03-074709ad50c7 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:41 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-362cd5e7-e136-4fe8-bc06-80f17c030e4d req-b4c59ee9-7c00-4829-bd03-074709ad50c7 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:41 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-362cd5e7-e136-4fe8-bc06-80f17c030e4d req-b4c59ee9-7c00-4829-bd03-074709ad50c7 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:41 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-362cd5e7-e136-4fe8-bc06-80f17c030e4d req-b4c59ee9-7c00-4829-bd03-074709ad50c7 service nova] Creating event network-changed:969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b for instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 on user Apr 18 14:31:41 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-362cd5e7-e136-4fe8-bc06-80f17c030e4d req-b4c59ee9-7c00-4829-bd03-074709ad50c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034733 Apr 18 14:31:41 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 51/150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:41 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-f0cc19a2-9ed9-4659-bb1e-fcfbc0b4223b req-22e23661-648c-40d3-b14e-abeb1b85016c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b6bf0a-d424-43fe-b5fd-3a6843bb1672", "name": "network-vif-deleted", "tag": "9e209b67-100e-4779-abbd-38cfc3b4568a"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:41 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-f0cc19a2-9ed9-4659-bb1e-fcfbc0b4223b req-22e23661-648c-40d3-b14e-abeb1b85016c service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:41 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-f0cc19a2-9ed9-4659-bb1e-fcfbc0b4223b req-22e23661-648c-40d3-b14e-abeb1b85016c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:41 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-f0cc19a2-9ed9-4659-bb1e-fcfbc0b4223b req-22e23661-648c-40d3-b14e-abeb1b85016c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:41 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-f0cc19a2-9ed9-4659-bb1e-fcfbc0b4223b req-22e23661-648c-40d3-b14e-abeb1b85016c service nova] Creating event network-vif-deleted:9e209b67-100e-4779-abbd-38cfc3b4568a for instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 on user Apr 18 14:31:41 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-f0cc19a2-9ed9-4659-bb1e-fcfbc0b4223b req-22e23661-648c-40d3-b14e-abeb1b85016c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033930 Apr 18 14:31:41 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 50/151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:42 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-8d155a99-227d-4d94-8e70-7fdd661b0d17 req-743f3506-ad25-432e-b445-24f537420c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b6bf0a-d424-43fe-b5fd-3a6843bb1672", "name": "network-vif-plugged", "status": "completed", "tag": "9e209b67-100e-4779-abbd-38cfc3b4568a"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8d155a99-227d-4d94-8e70-7fdd661b0d17 req-743f3506-ad25-432e-b445-24f537420c0e service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8d155a99-227d-4d94-8e70-7fdd661b0d17 req-743f3506-ad25-432e-b445-24f537420c0e service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8d155a99-227d-4d94-8e70-7fdd661b0d17 req-743f3506-ad25-432e-b445-24f537420c0e service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:42 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-8d155a99-227d-4d94-8e70-7fdd661b0d17 req-743f3506-ad25-432e-b445-24f537420c0e service nova] Creating event network-vif-plugged:9e209b67-100e-4779-abbd-38cfc3b4568a for instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 on user Apr 18 14:31:42 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-8d155a99-227d-4d94-8e70-7fdd661b0d17 req-743f3506-ad25-432e-b445-24f537420c0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035301 Apr 18 14:31:42 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 51/152] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:44 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-608782cc-6ca0-4c4d-b9c4-2a25c8970bd2 req-5d71b58f-5ad4-4bec-80eb-91f32a9fc648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b44765-7b1f-449a-bd4d-99d1df340ba4", "name": "network-vif-plugged", "status": "completed", "tag": "969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b"}, {"server_uuid": "38b44765-7b1f-449a-bd4d-99d1df340ba4", "name": "network-vif-plugged", "status": "completed", "tag": "969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:44 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-608782cc-6ca0-4c4d-b9c4-2a25c8970bd2 req-5d71b58f-5ad4-4bec-80eb-91f32a9fc648 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:44 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-608782cc-6ca0-4c4d-b9c4-2a25c8970bd2 req-5d71b58f-5ad4-4bec-80eb-91f32a9fc648 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:44 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-608782cc-6ca0-4c4d-b9c4-2a25c8970bd2 req-5d71b58f-5ad4-4bec-80eb-91f32a9fc648 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:44 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-608782cc-6ca0-4c4d-b9c4-2a25c8970bd2 req-5d71b58f-5ad4-4bec-80eb-91f32a9fc648 service nova] Creating event network-vif-plugged:969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b for instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 on user Apr 18 14:31:44 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-608782cc-6ca0-4c4d-b9c4-2a25c8970bd2 req-5d71b58f-5ad4-4bec-80eb-91f32a9fc648 service nova] Creating event network-vif-plugged:969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b for instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 on user Apr 18 14:31:44 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-608782cc-6ca0-4c4d-b9c4-2a25c8970bd2 req-5d71b58f-5ad4-4bec-80eb-91f32a9fc648 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028598 Apr 18 14:31:44 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 52/153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:52 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=8 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:52 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=16 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:52 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-37dfac01-5884-4dd6-b37d-80f682fdb3c6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:52 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-37dfac01-5884-4dd6-b37d-80f682fdb3c6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 909db006-c38d-4b50-acaa-4224aed6ea45] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:52 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-37dfac01-5884-4dd6-b37d-80f682fdb3c6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:52 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-37dfac01-5884-4dd6-b37d-80f682fdb3c6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:52 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-37dfac01-5884-4dd6-b37d-80f682fdb3c6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:52 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-37dfac01-5884-4dd6-b37d-80f682fdb3c6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:52 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-37dfac01-5884-4dd6-b37d-80f682fdb3c6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:52 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-37dfac01-5884-4dd6-b37d-80f682fdb3c6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:52 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-37dfac01-5884-4dd6-b37d-80f682fdb3c6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e284b794c4043768af56fd58fceb837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ca11d8beec4410a8a4c8ae7c8e4bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:31:52 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-37dfac01-5884-4dd6-b37d-80f682fdb3c6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45" status: 200 len: 1488 microversion: 2.1 time: 0.271976 Apr 18 14:31:52 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 51/154] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:31:52 2023] GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45 => generated 1488 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:31:54 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:54 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=10 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:54 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=10 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-1b89e21c-8ecd-4240-afa7-90a52021bf3e tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:54 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-1b89e21c-8ecd-4240-afa7-90a52021bf3e tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: 1b25948f-1d8c-4058-b3ed-8dca864de019] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-1b89e21c-8ecd-4240-afa7-90a52021bf3e tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-1b89e21c-8ecd-4240-afa7-90a52021bf3e tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-1b89e21c-8ecd-4240-afa7-90a52021bf3e tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-1b89e21c-8ecd-4240-afa7-90a52021bf3e tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-1b89e21c-8ecd-4240-afa7-90a52021bf3e tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-1b89e21c-8ecd-4240-afa7-90a52021bf3e tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:54 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-1b89e21c-8ecd-4240-afa7-90a52021bf3e tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b209357fca7f40c0b52507a285e054e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312c2b6e41142799cb66dd1377558d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:31:54 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-1b89e21c-8ecd-4240-afa7-90a52021bf3e tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019" status: 200 len: 1493 microversion: 2.1 time: 0.245098 Apr 18 14:31:54 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 52/155] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:31:54 2023] GET /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019 => generated 1493 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-a96e3ea4-74f6-4f19-937e-cd57297ce574 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-a96e3ea4-74f6-4f19-937e-cd57297ce574 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] [instance: 0942f138-80f9-44d8-acc5-56e60098b8e9] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-a96e3ea4-74f6-4f19-937e-cd57297ce574 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-a96e3ea4-74f6-4f19-937e-cd57297ce574 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-a96e3ea4-74f6-4f19-937e-cd57297ce574 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-a96e3ea4-74f6-4f19-937e-cd57297ce574 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-a96e3ea4-74f6-4f19-937e-cd57297ce574 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-a96e3ea4-74f6-4f19-937e-cd57297ce574 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:57 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-a96e3ea4-74f6-4f19-937e-cd57297ce574 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] [instance: 0942f138-80f9-44d8-acc5-56e60098b8e9] Going to try to terminate instance {{(pid=61310) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:31:57 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-a96e3ea4-74f6-4f19-937e-cd57297ce574 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0942f138-80f9-44d8-acc5-56e60098b8e9" status: 204 len: 0 microversion: 2.1 time: 0.131937 Apr 18 14:31:57 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 53/156] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:31:57 2023] DELETE /compute/v2.1/servers/0942f138-80f9-44d8-acc5-56e60098b8e9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:31:57 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-49b54e1e-1294-4194-b8c9-cd13ebffbfa5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:31:57 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-49b54e1e-1294-4194-b8c9-cd13ebffbfa5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] [instance: 0942f138-80f9-44d8-acc5-56e60098b8e9] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:31:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-49b54e1e-1294-4194-b8c9-cd13ebffbfa5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-49b54e1e-1294-4194-b8c9-cd13ebffbfa5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-49b54e1e-1294-4194-b8c9-cd13ebffbfa5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-49b54e1e-1294-4194-b8c9-cd13ebffbfa5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-49b54e1e-1294-4194-b8c9-cd13ebffbfa5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-49b54e1e-1294-4194-b8c9-cd13ebffbfa5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:58 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-fb99dc9a-849e-4587-86dd-ae723aac4891 req-f2ddf391-7bdc-44e8-87a7-932877f1e579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0942f138-80f9-44d8-acc5-56e60098b8e9", "name": "network-vif-unplugged", "status": "completed", "tag": "9859adab-a035-4e60-89d0-0d5749ad5fa1"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-fb99dc9a-849e-4587-86dd-ae723aac4891 req-f2ddf391-7bdc-44e8-87a7-932877f1e579 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-fb99dc9a-849e-4587-86dd-ae723aac4891 req-f2ddf391-7bdc-44e8-87a7-932877f1e579 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-fb99dc9a-849e-4587-86dd-ae723aac4891 req-f2ddf391-7bdc-44e8-87a7-932877f1e579 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:58 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-fb99dc9a-849e-4587-86dd-ae723aac4891 req-f2ddf391-7bdc-44e8-87a7-932877f1e579 service nova] Creating event network-vif-unplugged:9859adab-a035-4e60-89d0-0d5749ad5fa1 for instance 0942f138-80f9-44d8-acc5-56e60098b8e9 on user Apr 18 14:31:58 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-49b54e1e-1294-4194-b8c9-cd13ebffbfa5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a910fffabb433b9378b8a3e487bbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd819b77200604437b32f3f6037b31b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:31:58 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-fb99dc9a-849e-4587-86dd-ae723aac4891 req-f2ddf391-7bdc-44e8-87a7-932877f1e579 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030660 Apr 18 14:31:58 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 53/157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:31:58 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-49b54e1e-1294-4194-b8c9-cd13ebffbfa5 tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0942f138-80f9-44d8-acc5-56e60098b8e9" status: 200 len: 1492 microversion: 2.1 time: 0.252031 Apr 18 14:31:58 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 52/158] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:31:57 2023] GET /compute/v2.1/servers/0942f138-80f9-44d8-acc5-56e60098b8e9 => generated 1492 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:31:58 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-a1f6064d-3e1c-4775-a59f-4bf219355f16 req-0ed78fd6-b42b-46f2-9214-03aa3a5fa548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0942f138-80f9-44d8-acc5-56e60098b8e9", "name": "network-vif-deleted", "tag": "9859adab-a035-4e60-89d0-0d5749ad5fa1"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:31:59 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-a1f6064d-3e1c-4775-a59f-4bf219355f16 req-0ed78fd6-b42b-46f2-9214-03aa3a5fa548 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:31:59 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-a1f6064d-3e1c-4775-a59f-4bf219355f16 req-0ed78fd6-b42b-46f2-9214-03aa3a5fa548 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:31:59 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-a1f6064d-3e1c-4775-a59f-4bf219355f16 req-0ed78fd6-b42b-46f2-9214-03aa3a5fa548 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:31:59 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-a1f6064d-3e1c-4775-a59f-4bf219355f16 req-0ed78fd6-b42b-46f2-9214-03aa3a5fa548 service nova] Creating event network-vif-deleted:9859adab-a035-4e60-89d0-0d5749ad5fa1 for instance 0942f138-80f9-44d8-acc5-56e60098b8e9 on user Apr 18 14:31:59 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-a1f6064d-3e1c-4775-a59f-4bf219355f16 req-0ed78fd6-b42b-46f2-9214-03aa3a5fa548 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029044 Apr 18 14:31:59 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 54/159] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:31:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:32:00 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-ac400b4e-82a2-43a2-854e-f6674882244e req-ab2b4682-2e04-483e-8733-1eccd83fa17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0942f138-80f9-44d8-acc5-56e60098b8e9", "name": "network-vif-plugged", "status": "completed", "tag": "9859adab-a035-4e60-89d0-0d5749ad5fa1"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:32:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-ac400b4e-82a2-43a2-854e-f6674882244e req-ab2b4682-2e04-483e-8733-1eccd83fa17c service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-ac400b4e-82a2-43a2-854e-f6674882244e req-ab2b4682-2e04-483e-8733-1eccd83fa17c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-ac400b4e-82a2-43a2-854e-f6674882244e req-ab2b4682-2e04-483e-8733-1eccd83fa17c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:00 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-ac400b4e-82a2-43a2-854e-f6674882244e req-ab2b4682-2e04-483e-8733-1eccd83fa17c service nova] Creating event network-vif-plugged:9859adab-a035-4e60-89d0-0d5749ad5fa1 for instance 0942f138-80f9-44d8-acc5-56e60098b8e9 on user Apr 18 14:32:00 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-ac400b4e-82a2-43a2-854e-f6674882244e req-ab2b4682-2e04-483e-8733-1eccd83fa17c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031103 Apr 18 14:32:00 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 54/160] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:32:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:32:03 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-d5366fd3-8b22-40a6-b8c4-33ed829d1b59 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:03 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-d5366fd3-8b22-40a6-b8c4-33ed829d1b59 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 6dcffb71-055a-4ae6-bf65-df885c035e5a] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:03 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d5366fd3-8b22-40a6-b8c4-33ed829d1b59 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:03 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d5366fd3-8b22-40a6-b8c4-33ed829d1b59 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:03 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d5366fd3-8b22-40a6-b8c4-33ed829d1b59 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:03 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d5366fd3-8b22-40a6-b8c4-33ed829d1b59 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:03 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d5366fd3-8b22-40a6-b8c4-33ed829d1b59 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:03 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d5366fd3-8b22-40a6-b8c4-33ed829d1b59 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:03 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-d5366fd3-8b22-40a6-b8c4-33ed829d1b59 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] HTTP exception thrown: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:32:03 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-d5366fd3-8b22-40a6-b8c4-33ed829d1b59 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Request method failure captured: Apr 18 14:32:03 user devstack@n-api.service[61311]: request: GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a HTTP/1.1 Apr 18 14:32:03 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:32:03 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:32:03 user devstack@n-api.service[61311]: Connection: close Apr 18 14:32:03 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:32:03 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:32:03 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:32:03 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:32:03 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqk04uBwuqpXGvA4GAJytq0eMq0TbFZPqKdiT9GWHczMKlYJwXeVngWkOgi81EMnzelj2C6ObSST4iIXw45_QfB4NnyqH32wTn0yYnJSTtmNkzF_c5d3G_f_qqTa01BtjWV3rhZC_FNNyAe43SrsHjgP3irY_Dz-2Be3wLBPiA_qT2s Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Project-Id: 88dd648f400c48f384c828c3933baa5a Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Project-Name: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Tenant: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Tenant-Id: 88dd648f400c48f384c828c3933baa5a Apr 18 14:32:03 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:32:03 user devstack@n-api.service[61311]: X-User: tempest-AttachVolumeTestJSON-1067811846-project-member Apr 18 14:32:03 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:32:03 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:32:03 user devstack@n-api.service[61311]: X-User-Id: 36b9b392cafe4b58b429be8e010baa08 Apr 18 14:32:03 user devstack@n-api.service[61311]: X-User-Name: tempest-AttachVolumeTestJSON-1067811846-project-member Apr 18 14:32:03 user devstack@n-api.service[61311]: method: > Apr 18 14:32:03 user devstack@n-api.service[61311]: exception: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:32:03 user devstack@n-api.service[61311]: action_args: {'id': '6dcffb71-055a-4ae6-bf65-df885c035e5a'} Apr 18 14:32:03 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:32:03 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:03 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-d5366fd3-8b22-40a6-b8c4-33ed829d1b59 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Returning 404 to user: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:32:03 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-d5366fd3-8b22-40a6-b8c4-33ed829d1b59 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a" status: 404 len: 111 microversion: 2.1 time: 0.038610 Apr 18 14:32:03 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 53/161] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:03 2023] GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:32:03 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-88ab53e8-bf75-4786-bb07-f236287f2ae7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '.version_select at 0x7f5ceeb63880>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:03 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-88ab53e8-bf75-4786-bb07-f236287f2ae7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-791769318" status: 202 len: 0 microversion: 2.1 time: 0.025241 Apr 18 14:32:03 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 55/162] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 14:32:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-791769318 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:32:04 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-3b247436-cbbc-4a27-b40d-2e2624538c07 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Action: 'create', calling method: .version_select at 0x7f5ceeb92560>, body: {"keypair": {"name": "tempest-keypair-1743159305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEl9t0UHIhtcly+kGaj7dwzKb8ZTXw4sa1QxSyAobWK0io8dnjDrCzNW7F/ebIDwgxKblb4WihsDkQ9ffD46u5NqO9shDzXkZ3Rp6yG0tH/Hyiq8dwQ35BcGsmL8kQPyA=="}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:32:04 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-3b247436-cbbc-4a27-b40d-2e2624538c07 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Getting quotas for project 88dd648f400c48f384c828c3933baa5a. Resources: {'key_pairs'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:32:04 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-3b247436-cbbc-4a27-b40d-2e2624538c07 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Getting quotas for user 36b9b392cafe4b58b429be8e010baa08 and project 88dd648f400c48f384c828c3933baa5a. Resources: {'key_pairs'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:32:04 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-3b247436-cbbc-4a27-b40d-2e2624538c07 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050633 Apr 18 14:32:04 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 55/163] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:32:04 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-112464000", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d3e19e74-bda1-4d28-b7e4-e98675072612"}], "security_groups": [{"name": "tempest-securitygroup--1787253608"}], "key_name": "tempest-keypair-1743159305", "user_data": "}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG nova.network.neutron [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] validate_networks() for [('d3e19e74-bda1-4d28-b7e4-e98675072612', None, None, None, None, None)] {{(pid=61311) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:32:06 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-a893a628-a9b9-4a09-886e-d17337a9aa5d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:06 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-a893a628-a9b9-4a09-886e-d17337a9aa5d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-a893a628-a9b9-4a09-886e-d17337a9aa5d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-a893a628-a9b9-4a09-886e-d17337a9aa5d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-a893a628-a9b9-4a09-886e-d17337a9aa5d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-a893a628-a9b9-4a09-886e-d17337a9aa5d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-a893a628-a9b9-4a09-886e-d17337a9aa5d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-a893a628-a9b9-4a09-886e-d17337a9aa5d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:06 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-a893a628-a9b9-4a09-886e-d17337a9aa5d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:32:06 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-a893a628-a9b9-4a09-886e-d17337a9aa5d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1656 microversion: 2.1 time: 0.226649 Apr 18 14:32:06 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 56/164] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:06 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1656 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:32:06 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-da33f1aa-3d99-4c17-882f-60fdc101c03f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:06 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-da33f1aa-3d99-4c17-882f-60fdc101c03f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:06 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-da33f1aa-3d99-4c17-882f-60fdc101c03f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:06 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-da33f1aa-3d99-4c17-882f-60fdc101c03f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:06 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-da33f1aa-3d99-4c17-882f-60fdc101c03f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:06 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-da33f1aa-3d99-4c17-882f-60fdc101c03f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:06 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-da33f1aa-3d99-4c17-882f-60fdc101c03f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:06 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-da33f1aa-3d99-4c17-882f-60fdc101c03f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:06 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-da33f1aa-3d99-4c17-882f-60fdc101c03f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:32:06 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-da33f1aa-3d99-4c17-882f-60fdc101c03f tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1656 microversion: 2.1 time: 0.160099 Apr 18 14:32:06 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 56/165] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:06 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1656 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Flavor limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Image limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Flavor pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Image pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Getting quotas for project 88dd648f400c48f384c828c3933baa5a. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Getting quotas for user 36b9b392cafe4b58b429be8e010baa08 and project 88dd648f400c48f384c828c3933baa5a. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Going to run 1 instances... {{(pid=61311) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:32:06 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 1fbf9e3f-365b-4749-8591-158ad177793f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:32:06 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-b7b20515-4945-4741-ab3c-9ad85ceb7d95 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.792742 Apr 18 14:32:06 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 54/166] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:32:06 2023] POST /compute/v2.1/servers => generated 400 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:32:06 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-799a7fa5-0063-4568-b4a6-49a4f74b495c tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:06 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-799a7fa5-0063-4568-b4a6-49a4f74b495c tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 1fbf9e3f-365b-4749-8591-158ad177793f] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:06 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-799a7fa5-0063-4568-b4a6-49a4f74b495c tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b9b392cafe4b58b429be8e010baa08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88dd648f400c48f384c828c3933baa5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:32:06 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-799a7fa5-0063-4568-b4a6-49a4f74b495c tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f" status: 200 len: 1231 microversion: 2.1 time: 0.066843 Apr 18 14:32:06 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 57/167] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:06 2023] GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f => generated 1231 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:32:09 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-74d43238-989a-44c7-83dd-bd377a7e579f req-b8006ddf-32ab-4d27-af8d-1d74b55f6014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbf9e3f-365b-4749-8591-158ad177793f", "tag": "0abc5ad0-4c5b-4585-bdb1-88832e4974fd"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:32:09 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-74d43238-989a-44c7-83dd-bd377a7e579f req-b8006ddf-32ab-4d27-af8d-1d74b55f6014 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:09 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-74d43238-989a-44c7-83dd-bd377a7e579f req-b8006ddf-32ab-4d27-af8d-1d74b55f6014 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:09 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-74d43238-989a-44c7-83dd-bd377a7e579f req-b8006ddf-32ab-4d27-af8d-1d74b55f6014 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:09 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-74d43238-989a-44c7-83dd-bd377a7e579f req-b8006ddf-32ab-4d27-af8d-1d74b55f6014 service nova] Creating event network-changed:0abc5ad0-4c5b-4585-bdb1-88832e4974fd for instance 1fbf9e3f-365b-4749-8591-158ad177793f on user Apr 18 14:32:09 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-74d43238-989a-44c7-83dd-bd377a7e579f req-b8006ddf-32ab-4d27-af8d-1d74b55f6014 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028869 Apr 18 14:32:09 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 57/168] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:32:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:32:11 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-e0eed772-ecc5-4611-9299-29e97849ef8f req-f1090fb2-c18d-4daf-8e26-98536cc01fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbf9e3f-365b-4749-8591-158ad177793f", "name": "network-vif-plugged", "status": "completed", "tag": "0abc5ad0-4c5b-4585-bdb1-88832e4974fd"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:32:11 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-e0eed772-ecc5-4611-9299-29e97849ef8f req-f1090fb2-c18d-4daf-8e26-98536cc01fd3 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:11 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-e0eed772-ecc5-4611-9299-29e97849ef8f req-f1090fb2-c18d-4daf-8e26-98536cc01fd3 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:11 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-e0eed772-ecc5-4611-9299-29e97849ef8f req-f1090fb2-c18d-4daf-8e26-98536cc01fd3 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:11 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-e0eed772-ecc5-4611-9299-29e97849ef8f req-f1090fb2-c18d-4daf-8e26-98536cc01fd3 service nova] Creating event network-vif-plugged:0abc5ad0-4c5b-4585-bdb1-88832e4974fd for instance 1fbf9e3f-365b-4749-8591-158ad177793f on user Apr 18 14:32:11 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-e0eed772-ecc5-4611-9299-29e97849ef8f req-f1090fb2-c18d-4daf-8e26-98536cc01fd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041564 Apr 18 14:32:11 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 55/169] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:32:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:32:13 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-3e9b3249-f303-405c-a5f3-3427888f9a02 req-11251e80-1604-4276-b469-b0f738e02d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbf9e3f-365b-4749-8591-158ad177793f", "name": "network-vif-plugged", "status": "completed", "tag": "0abc5ad0-4c5b-4585-bdb1-88832e4974fd"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:32:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-3e9b3249-f303-405c-a5f3-3427888f9a02 req-11251e80-1604-4276-b469-b0f738e02d2e service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-3e9b3249-f303-405c-a5f3-3427888f9a02 req-11251e80-1604-4276-b469-b0f738e02d2e service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-3e9b3249-f303-405c-a5f3-3427888f9a02 req-11251e80-1604-4276-b469-b0f738e02d2e service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:13 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-3e9b3249-f303-405c-a5f3-3427888f9a02 req-11251e80-1604-4276-b469-b0f738e02d2e service nova] Creating event network-vif-plugged:0abc5ad0-4c5b-4585-bdb1-88832e4974fd for instance 1fbf9e3f-365b-4749-8591-158ad177793f on user Apr 18 14:32:13 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-3e9b3249-f303-405c-a5f3-3427888f9a02 req-11251e80-1604-4276-b469-b0f738e02d2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029345 Apr 18 14:32:13 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 58/170] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:32:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=4 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=18 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-6519a062-00ce-4797-bad5-ba906ec69e60 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-6519a062-00ce-4797-bad5-ba906ec69e60 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: 2bee7710-8a40-47bc-89b7-f0cf4def19b3] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-6519a062-00ce-4797-bad5-ba906ec69e60 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-6519a062-00ce-4797-bad5-ba906ec69e60 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-6519a062-00ce-4797-bad5-ba906ec69e60 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-6519a062-00ce-4797-bad5-ba906ec69e60 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-6519a062-00ce-4797-bad5-ba906ec69e60 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-6519a062-00ce-4797-bad5-ba906ec69e60 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-6519a062-00ce-4797-bad5-ba906ec69e60 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae2d60ff00f4be59827e15aece5d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:32:28 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-6519a062-00ce-4797-bad5-ba906ec69e60 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3" status: 200 len: 1537 microversion: 2.1 time: 0.221452 Apr 18 14:32:28 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 58/171] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:28 2023] GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3 => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-4a9c6da3-5130-48a1-80ff-bd72828ce945 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-4a9c6da3-5130-48a1-80ff-bd72828ce945 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ae2d60ff00f4be59827e15aece5d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-4a9c6da3-5130-48a1-80ff-bd72828ce945 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Searching by: {'deleted': False, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8'} {{(pid=61311) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=18 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a9c6da3-5130-48a1-80ff-bd72828ce945 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a9c6da3-5130-48a1-80ff-bd72828ce945 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a9c6da3-5130-48a1-80ff-bd72828ce945 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a9c6da3-5130-48a1-80ff-bd72828ce945 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a9c6da3-5130-48a1-80ff-bd72828ce945 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a9c6da3-5130-48a1-80ff-bd72828ce945 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:28 user devstack@n-api.service[61311]: DEBUG nova.compute.multi_cell_list [None req-4a9c6da3-5130-48a1-80ff-bd72828ce945 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61311) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 14:32:28 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-4a9c6da3-5130-48a1-80ff-bd72828ce945 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.204891 Apr 18 14:32:28 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 56/172] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 14:32:28 2023] GET /compute/v2.1/servers => generated 341 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:32:28 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-c77ba498-2e6c-4d0e-b8da-38ea3b15546b tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:28 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-c77ba498-2e6c-4d0e-b8da-38ea3b15546b tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: 2bee7710-8a40-47bc-89b7-f0cf4def19b3] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:28 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:28 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:28 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:28 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c77ba498-2e6c-4d0e-b8da-38ea3b15546b tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:28 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c77ba498-2e6c-4d0e-b8da-38ea3b15546b tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:28 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c77ba498-2e6c-4d0e-b8da-38ea3b15546b tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:28 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c77ba498-2e6c-4d0e-b8da-38ea3b15546b tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:28 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c77ba498-2e6c-4d0e-b8da-38ea3b15546b tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:28 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c77ba498-2e6c-4d0e-b8da-38ea3b15546b tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-eb48914c-b50e-478c-ac05-d7725dc86cb1 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-eb48914c-b50e-478c-ac05-d7725dc86cb1 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 38b44765-7b1f-449a-bd4d-99d1df340ba4] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-eb48914c-b50e-478c-ac05-d7725dc86cb1 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-eb48914c-b50e-478c-ac05-d7725dc86cb1 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-eb48914c-b50e-478c-ac05-d7725dc86cb1 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-eb48914c-b50e-478c-ac05-d7725dc86cb1 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-eb48914c-b50e-478c-ac05-d7725dc86cb1 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-eb48914c-b50e-478c-ac05-d7725dc86cb1 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:28 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-c77ba498-2e6c-4d0e-b8da-38ea3b15546b tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae2d60ff00f4be59827e15aece5d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:32:28 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-c77ba498-2e6c-4d0e-b8da-38ea3b15546b tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3" status: 200 len: 1537 microversion: 2.1 time: 0.141157 Apr 18 14:32:28 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 59/173] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:28 2023] GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3 => generated 1537 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:32:28 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-eb48914c-b50e-478c-ac05-d7725dc86cb1 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039b3016f884a42abcb58054d649cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1e17fb95d64cae9c6c210d143d115b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:32:28 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-eb48914c-b50e-478c-ac05-d7725dc86cb1 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38b44765-7b1f-449a-bd4d-99d1df340ba4" status: 200 len: 1495 microversion: 2.1 time: 0.209779 Apr 18 14:32:28 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 59/174] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:28 2023] GET /compute/v2.1/servers/38b44765-7b1f-449a-bd4d-99d1df340ba4 => generated 1495 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-4a46e789-cc40-4ac8-ab62-a1516137360d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-4a46e789-cc40-4ac8-ab62-a1516137360d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: 2bee7710-8a40-47bc-89b7-f0cf4def19b3] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a46e789-cc40-4ac8-ab62-a1516137360d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a46e789-cc40-4ac8-ab62-a1516137360d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a46e789-cc40-4ac8-ab62-a1516137360d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a46e789-cc40-4ac8-ab62-a1516137360d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a46e789-cc40-4ac8-ab62-a1516137360d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a46e789-cc40-4ac8-ab62-a1516137360d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-4a46e789-cc40-4ac8-ab62-a1516137360d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: 2bee7710-8a40-47bc-89b7-f0cf4def19b3] Going to try to terminate instance {{(pid=61311) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:32:30 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-4a46e789-cc40-4ac8-ab62-a1516137360d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3" status: 204 len: 0 microversion: 2.1 time: 0.111283 Apr 18 14:32:30 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 57/175] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:32:30 2023] DELETE /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:32:30 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-3aed1f22-9223-40bd-81ab-4c9d0e9ca47f tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:30 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-3aed1f22-9223-40bd-81ab-4c9d0e9ca47f tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: 2bee7710-8a40-47bc-89b7-f0cf4def19b3] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3aed1f22-9223-40bd-81ab-4c9d0e9ca47f tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3aed1f22-9223-40bd-81ab-4c9d0e9ca47f tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3aed1f22-9223-40bd-81ab-4c9d0e9ca47f tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3aed1f22-9223-40bd-81ab-4c9d0e9ca47f tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3aed1f22-9223-40bd-81ab-4c9d0e9ca47f tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3aed1f22-9223-40bd-81ab-4c9d0e9ca47f tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:30 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-3aed1f22-9223-40bd-81ab-4c9d0e9ca47f tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae2d60ff00f4be59827e15aece5d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:32:30 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-3aed1f22-9223-40bd-81ab-4c9d0e9ca47f tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3" status: 200 len: 1543 microversion: 2.1 time: 0.174033 Apr 18 14:32:30 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 60/176] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:30 2023] GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3 => generated 1543 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:32:30 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-8e5da018-437f-412a-becd-6842cf67bc89 req-65e239c8-0f14-4bc3-8a22-9cd163e29263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bee7710-8a40-47bc-89b7-f0cf4def19b3", "name": "network-vif-unplugged", "status": "completed", "tag": "6a56aa1a-ddbb-4d13-bc54-cdb64c02282f"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:32:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8e5da018-437f-412a-becd-6842cf67bc89 req-65e239c8-0f14-4bc3-8a22-9cd163e29263 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8e5da018-437f-412a-becd-6842cf67bc89 req-65e239c8-0f14-4bc3-8a22-9cd163e29263 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8e5da018-437f-412a-becd-6842cf67bc89 req-65e239c8-0f14-4bc3-8a22-9cd163e29263 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:30 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-8e5da018-437f-412a-becd-6842cf67bc89 req-65e239c8-0f14-4bc3-8a22-9cd163e29263 service nova] Creating event network-vif-unplugged:6a56aa1a-ddbb-4d13-bc54-cdb64c02282f for instance 2bee7710-8a40-47bc-89b7-f0cf4def19b3 on user Apr 18 14:32:30 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-8e5da018-437f-412a-becd-6842cf67bc89 req-65e239c8-0f14-4bc3-8a22-9cd163e29263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029792 Apr 18 14:32:30 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 60/177] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:32:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-4f62a9a7-17ae-488b-8d1c-cc0e6b72622a tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-4f62a9a7-17ae-488b-8d1c-cc0e6b72622a tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] [instance: 51b6bf0a-d424-43fe-b5fd-3a6843bb1672] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4f62a9a7-17ae-488b-8d1c-cc0e6b72622a tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4f62a9a7-17ae-488b-8d1c-cc0e6b72622a tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4f62a9a7-17ae-488b-8d1c-cc0e6b72622a tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4f62a9a7-17ae-488b-8d1c-cc0e6b72622a tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4f62a9a7-17ae-488b-8d1c-cc0e6b72622a tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4f62a9a7-17ae-488b-8d1c-cc0e6b72622a tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:30 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-4f62a9a7-17ae-488b-8d1c-cc0e6b72622a tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] HTTP exception thrown: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-4f62a9a7-17ae-488b-8d1c-cc0e6b72622a tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Request method failure captured: Apr 18 14:32:30 user devstack@n-api.service[61311]: request: GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672 HTTP/1.1 Apr 18 14:32:30 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:32:30 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:32:30 user devstack@n-api.service[61311]: Connection: close Apr 18 14:32:30 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:32:30 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:32:30 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:32:30 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:32:30 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqk5E1rwmHiTAPvD4jgsfdxt4qN8Y0ActTZEUFo0l_ljzOZ3lMljlULdFonhU9eJVrcnVO5Bx4GFLuxakJK9J0IAAlZ4-_BZxdFt-T0QT5DvHK4V0RA990L9ciAVCtJ_QsziQ1ZgxU5JHF9hOcU9PpgHySQdSZ97fyeAS-hpMmOU1_s Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Project-Id: 7cb471110565402aa21064786951ab00 Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-484453651 Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cb471110565402aa21064786951ab00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7cb471110565402aa21064786951ab00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cb471110565402aa21064786951ab00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-484453651 Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Tenant-Id: 7cb471110565402aa21064786951ab00 Apr 18 14:32:30 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-484453651 Apr 18 14:32:30 user devstack@n-api.service[61311]: X-User: tempest-AttachSCSIVolumeTestJSON-484453651-project-member Apr 18 14:32:30 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:32:30 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:32:30 user devstack@n-api.service[61311]: X-User-Id: 6b50d25047934c9fad65b69209730a0e Apr 18 14:32:30 user devstack@n-api.service[61311]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-484453651-project-member Apr 18 14:32:30 user devstack@n-api.service[61311]: method: > Apr 18 14:32:30 user devstack@n-api.service[61311]: exception: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:30 user devstack@n-api.service[61311]: action_args: {'id': '51b6bf0a-d424-43fe-b5fd-3a6843bb1672'} Apr 18 14:32:30 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:30 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:30 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-4f62a9a7-17ae-488b-8d1c-cc0e6b72622a tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Returning 404 to user: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:32:30 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-4f62a9a7-17ae-488b-8d1c-cc0e6b72622a tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672" status: 404 len: 111 microversion: 2.1 time: 0.028138 Apr 18 14:32:30 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 58/178] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:30 2023] GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:32:30 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-bb69e757-cb0d-41d0-968d-fa58bee4e749 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Calling method '.version_select at 0x7f5ceec6e5f0>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:30 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-bb69e757-cb0d-41d0-968d-fa58bee4e749 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-998303201" status: 202 len: 0 microversion: 2.1 time: 0.019846 Apr 18 14:32:30 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 61/179] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 14:32:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-998303201 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:32:31 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-0fa4d298-1793-442f-8527-e8fedcbfceb2 req-fcf58ecf-6b1f-4120-a0ff-f8539b8634f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bee7710-8a40-47bc-89b7-f0cf4def19b3", "name": "network-vif-deleted", "tag": "6a56aa1a-ddbb-4d13-bc54-cdb64c02282f"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:32:31 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0fa4d298-1793-442f-8527-e8fedcbfceb2 req-fcf58ecf-6b1f-4120-a0ff-f8539b8634f7 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:31 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0fa4d298-1793-442f-8527-e8fedcbfceb2 req-fcf58ecf-6b1f-4120-a0ff-f8539b8634f7 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:31 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0fa4d298-1793-442f-8527-e8fedcbfceb2 req-fcf58ecf-6b1f-4120-a0ff-f8539b8634f7 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:31 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-0fa4d298-1793-442f-8527-e8fedcbfceb2 req-fcf58ecf-6b1f-4120-a0ff-f8539b8634f7 service nova] Creating event network-vif-deleted:6a56aa1a-ddbb-4d13-bc54-cdb64c02282f for instance 2bee7710-8a40-47bc-89b7-f0cf4def19b3 on user Apr 18 14:32:31 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-0fa4d298-1793-442f-8527-e8fedcbfceb2 req-fcf58ecf-6b1f-4120-a0ff-f8539b8634f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029805 Apr 18 14:32:31 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 61/180] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:32:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:32:31 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-d072ba84-dc5e-4921-8221-8ebfeee78517 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:31 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-d072ba84-dc5e-4921-8221-8ebfeee78517 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] [instance: 51b6bf0a-d424-43fe-b5fd-3a6843bb1672] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:31 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d072ba84-dc5e-4921-8221-8ebfeee78517 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:31 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d072ba84-dc5e-4921-8221-8ebfeee78517 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:31 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d072ba84-dc5e-4921-8221-8ebfeee78517 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:31 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d072ba84-dc5e-4921-8221-8ebfeee78517 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:31 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d072ba84-dc5e-4921-8221-8ebfeee78517 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:31 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d072ba84-dc5e-4921-8221-8ebfeee78517 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:31 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-d072ba84-dc5e-4921-8221-8ebfeee78517 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] HTTP exception thrown: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:31 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-d072ba84-dc5e-4921-8221-8ebfeee78517 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Request method failure captured: Apr 18 14:32:31 user devstack@n-api.service[61311]: request: DELETE /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672 HTTP/1.1 Apr 18 14:32:31 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:32:31 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:32:31 user devstack@n-api.service[61311]: Connection: close Apr 18 14:32:31 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:32:31 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:32:31 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:32:31 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:32:31 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqk5E1rwmHiTAPvD4jgsfdxt4qN8Y0ActTZEUFo0l_ljzOZ3lMljlULdFonhU9eJVrcnVO5Bx4GFLuxakJK9J0IAAlZ4-_BZxdFt-T0QT5DvHK4V0RA990L9ciAVCtJ_QsziQ1ZgxU5JHF9hOcU9PpgHySQdSZ97fyeAS-hpMmOU1_s Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Project-Id: 7cb471110565402aa21064786951ab00 Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-484453651 Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cb471110565402aa21064786951ab00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7cb471110565402aa21064786951ab00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cb471110565402aa21064786951ab00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-484453651 Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Tenant-Id: 7cb471110565402aa21064786951ab00 Apr 18 14:32:31 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-484453651 Apr 18 14:32:31 user devstack@n-api.service[61311]: X-User: tempest-AttachSCSIVolumeTestJSON-484453651-project-member Apr 18 14:32:31 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:32:31 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:32:31 user devstack@n-api.service[61311]: X-User-Id: 6b50d25047934c9fad65b69209730a0e Apr 18 14:32:31 user devstack@n-api.service[61311]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-484453651-project-member Apr 18 14:32:31 user devstack@n-api.service[61311]: method: > Apr 18 14:32:31 user devstack@n-api.service[61311]: exception: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:31 user devstack@n-api.service[61311]: action_args: {'id': '51b6bf0a-d424-43fe-b5fd-3a6843bb1672'} Apr 18 14:32:31 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:31 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:31 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-d072ba84-dc5e-4921-8221-8ebfeee78517 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Returning 404 to user: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:32:31 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-d072ba84-dc5e-4921-8221-8ebfeee78517 tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672" status: 404 len: 111 microversion: 2.1 time: 0.031194 Apr 18 14:32:31 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 59/181] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:32:31 2023] DELETE /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:32:31 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-2decb482-5499-44a6-90bb-ea320c4803fc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:31 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-2decb482-5499-44a6-90bb-ea320c4803fc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] [instance: 51b6bf0a-d424-43fe-b5fd-3a6843bb1672] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:31 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-2decb482-5499-44a6-90bb-ea320c4803fc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:31 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-2decb482-5499-44a6-90bb-ea320c4803fc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:31 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-2decb482-5499-44a6-90bb-ea320c4803fc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:31 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-2decb482-5499-44a6-90bb-ea320c4803fc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:31 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-2decb482-5499-44a6-90bb-ea320c4803fc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:31 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-2decb482-5499-44a6-90bb-ea320c4803fc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:31 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-2decb482-5499-44a6-90bb-ea320c4803fc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] HTTP exception thrown: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:31 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-2decb482-5499-44a6-90bb-ea320c4803fc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Request method failure captured: Apr 18 14:32:31 user devstack@n-api.service[61310]: request: GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672 HTTP/1.1 Apr 18 14:32:31 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:32:31 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:32:31 user devstack@n-api.service[61310]: Connection: close Apr 18 14:32:31 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:32:31 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:32:31 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:32:31 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:32:31 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqk5E1rwmHiTAPvD4jgsfdxt4qN8Y0ActTZEUFo0l_ljzOZ3lMljlULdFonhU9eJVrcnVO5Bx4GFLuxakJK9J0IAAlZ4-_BZxdFt-T0QT5DvHK4V0RA990L9ciAVCtJ_QsziQ1ZgxU5JHF9hOcU9PpgHySQdSZ97fyeAS-hpMmOU1_s Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Project-Id: 7cb471110565402aa21064786951ab00 Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-484453651 Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cb471110565402aa21064786951ab00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7cb471110565402aa21064786951ab00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cb471110565402aa21064786951ab00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-484453651 Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Tenant-Id: 7cb471110565402aa21064786951ab00 Apr 18 14:32:31 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-484453651 Apr 18 14:32:31 user devstack@n-api.service[61310]: X-User: tempest-AttachSCSIVolumeTestJSON-484453651-project-member Apr 18 14:32:31 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:32:31 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:32:31 user devstack@n-api.service[61310]: X-User-Id: 6b50d25047934c9fad65b69209730a0e Apr 18 14:32:31 user devstack@n-api.service[61310]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-484453651-project-member Apr 18 14:32:31 user devstack@n-api.service[61310]: method: > Apr 18 14:32:31 user devstack@n-api.service[61310]: exception: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:31 user devstack@n-api.service[61310]: action_args: {'id': '51b6bf0a-d424-43fe-b5fd-3a6843bb1672'} Apr 18 14:32:31 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. Apr 18 14:32:31 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:32:31 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-2decb482-5499-44a6-90bb-ea320c4803fc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] Returning 404 to user: Instance 51b6bf0a-d424-43fe-b5fd-3a6843bb1672 could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:32:31 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-2decb482-5499-44a6-90bb-ea320c4803fc tempest-AttachSCSIVolumeTestJSON-484453651 tempest-AttachSCSIVolumeTestJSON-484453651-project-member] 10.0.0.210 "GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672" status: 404 len: 111 microversion: 2.1 time: 0.046650 Apr 18 14:32:31 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 62/182] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:31 2023] GET /compute/v2.1/servers/51b6bf0a-d424-43fe-b5fd-3a6843bb1672 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:32:32 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-9d2b5da2-ef04-454e-a121-539bf6f1a496 req-fcd1637f-6950-4c80-8d66-aa1074f6aeb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bee7710-8a40-47bc-89b7-f0cf4def19b3", "name": "network-vif-plugged", "status": "completed", "tag": "6a56aa1a-ddbb-4d13-bc54-cdb64c02282f"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:32:32 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-9d2b5da2-ef04-454e-a121-539bf6f1a496 req-fcd1637f-6950-4c80-8d66-aa1074f6aeb5 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:32 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-9d2b5da2-ef04-454e-a121-539bf6f1a496 req-fcd1637f-6950-4c80-8d66-aa1074f6aeb5 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:32 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-9d2b5da2-ef04-454e-a121-539bf6f1a496 req-fcd1637f-6950-4c80-8d66-aa1074f6aeb5 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:32 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-9d2b5da2-ef04-454e-a121-539bf6f1a496 req-fcd1637f-6950-4c80-8d66-aa1074f6aeb5 service nova] Creating event network-vif-plugged:6a56aa1a-ddbb-4d13-bc54-cdb64c02282f for instance 2bee7710-8a40-47bc-89b7-f0cf4def19b3 on user Apr 18 14:32:32 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-9d2b5da2-ef04-454e-a121-539bf6f1a496 req-fcd1637f-6950-4c80-8d66-aa1074f6aeb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032736 Apr 18 14:32:32 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 62/183] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:32:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-cce0f036-24b4-40c0-badb-52cb18395b4a tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-cce0f036-24b4-40c0-badb-52cb18395b4a tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] [instance: 0942f138-80f9-44d8-acc5-56e60098b8e9] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cce0f036-24b4-40c0-badb-52cb18395b4a tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cce0f036-24b4-40c0-badb-52cb18395b4a tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cce0f036-24b4-40c0-badb-52cb18395b4a tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cce0f036-24b4-40c0-badb-52cb18395b4a tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cce0f036-24b4-40c0-badb-52cb18395b4a tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cce0f036-24b4-40c0-badb-52cb18395b4a tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:48 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-cce0f036-24b4-40c0-badb-52cb18395b4a tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] HTTP exception thrown: Instance 0942f138-80f9-44d8-acc5-56e60098b8e9 could not be found. Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-cce0f036-24b4-40c0-badb-52cb18395b4a tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Request method failure captured: Apr 18 14:32:48 user devstack@n-api.service[61311]: request: GET /compute/v2.1/servers/0942f138-80f9-44d8-acc5-56e60098b8e9 HTTP/1.1 Apr 18 14:32:48 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:32:48 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:32:48 user devstack@n-api.service[61311]: Connection: close Apr 18 14:32:48 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:32:48 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:32:48 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:32:48 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:32:48 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqlqWitZpXLylHiE_3etqes9rd6_ljvwIHuOdRqgWTxE08Jdbg9TS-eRxbmKtQJlxN0Oi0bV7cNkDe7e7BeU7yoOuW95JbNkVh3xP6hztP-Io38jcp33i560LEetiHIr9qLDt6FsAJ8DCsj5yD05kvngJ5zj4OXuyeCCWPdk6l5-sSQ Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Project-Id: d819b77200604437b32f3f6037b31b93 Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Project-Name: tempest-VolumesActionsTest-1056057753 Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d819b77200604437b32f3f6037b31b93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d819b77200604437b32f3f6037b31b93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d819b77200604437b32f3f6037b31b93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Tenant: tempest-VolumesActionsTest-1056057753 Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Tenant-Id: d819b77200604437b32f3f6037b31b93 Apr 18 14:32:48 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-VolumesActionsTest-1056057753 Apr 18 14:32:48 user devstack@n-api.service[61311]: X-User: tempest-VolumesActionsTest-1056057753-project-member Apr 18 14:32:48 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:32:48 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:32:48 user devstack@n-api.service[61311]: X-User-Id: b2a910fffabb433b9378b8a3e487bbd4 Apr 18 14:32:48 user devstack@n-api.service[61311]: X-User-Name: tempest-VolumesActionsTest-1056057753-project-member Apr 18 14:32:48 user devstack@n-api.service[61311]: method: > Apr 18 14:32:48 user devstack@n-api.service[61311]: exception: Instance 0942f138-80f9-44d8-acc5-56e60098b8e9 could not be found. Apr 18 14:32:48 user devstack@n-api.service[61311]: action_args: {'id': '0942f138-80f9-44d8-acc5-56e60098b8e9'} Apr 18 14:32:48 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0942f138-80f9-44d8-acc5-56e60098b8e9 could not be found. Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0942f138-80f9-44d8-acc5-56e60098b8e9 could not be found. Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0942f138-80f9-44d8-acc5-56e60098b8e9 could not be found. Apr 18 14:32:48 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:32:48 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-cce0f036-24b4-40c0-badb-52cb18395b4a tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] Returning 404 to user: Instance 0942f138-80f9-44d8-acc5-56e60098b8e9 could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:32:48 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-cce0f036-24b4-40c0-badb-52cb18395b4a tempest-VolumesActionsTest-1056057753 tempest-VolumesActionsTest-1056057753-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0942f138-80f9-44d8-acc5-56e60098b8e9" status: 404 len: 111 microversion: 2.1 time: 0.046129 Apr 18 14:32:48 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 60/184] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:48 2023] GET /compute/v2.1/servers/0942f138-80f9-44d8-acc5-56e60098b8e9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:32:52 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-39b9a15e-a0c6-4cec-a901-62cf203329f3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:52 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-39b9a15e-a0c6-4cec-a901-62cf203329f3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 1b067df0-2ea8-44e6-9418-98788edf4e7d] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:52 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:52 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=14 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-39b9a15e-a0c6-4cec-a901-62cf203329f3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-39b9a15e-a0c6-4cec-a901-62cf203329f3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-39b9a15e-a0c6-4cec-a901-62cf203329f3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-39b9a15e-a0c6-4cec-a901-62cf203329f3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-39b9a15e-a0c6-4cec-a901-62cf203329f3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-39b9a15e-a0c6-4cec-a901-62cf203329f3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:53 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-39b9a15e-a0c6-4cec-a901-62cf203329f3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e284b794c4043768af56fd58fceb837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ca11d8beec4410a8a4c8ae7c8e4bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:32:53 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-39b9a15e-a0c6-4cec-a901-62cf203329f3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b067df0-2ea8-44e6-9418-98788edf4e7d" status: 200 len: 1504 microversion: 2.1 time: 0.266459 Apr 18 14:32:53 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 63/185] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:52 2023] GET /compute/v2.1/servers/1b067df0-2ea8-44e6-9418-98788edf4e7d => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:32:54 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=10 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:54 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=18 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:32:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-429c718c-aa35-4b8c-9f0c-c8913240e607 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:54 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-429c718c-aa35-4b8c-9f0c-c8913240e607 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: 1b25948f-1d8c-4058-b3ed-8dca864de019] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-429c718c-aa35-4b8c-9f0c-c8913240e607 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-429c718c-aa35-4b8c-9f0c-c8913240e607 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-429c718c-aa35-4b8c-9f0c-c8913240e607 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-429c718c-aa35-4b8c-9f0c-c8913240e607 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-429c718c-aa35-4b8c-9f0c-c8913240e607 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-429c718c-aa35-4b8c-9f0c-c8913240e607 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:54 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-429c718c-aa35-4b8c-9f0c-c8913240e607 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: 1b25948f-1d8c-4058-b3ed-8dca864de019] Going to try to terminate instance {{(pid=61309) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:32:54 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-429c718c-aa35-4b8c-9f0c-c8913240e607 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019" status: 204 len: 0 microversion: 2.1 time: 0.142176 Apr 18 14:32:54 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 63/186] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:32:54 2023] DELETE /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:32:54 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-79651e1b-f597-4725-ab8b-dafe1210ef96 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:54 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-79651e1b-f597-4725-ab8b-dafe1210ef96 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: 1b25948f-1d8c-4058-b3ed-8dca864de019] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:54 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-79651e1b-f597-4725-ab8b-dafe1210ef96 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:54 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-79651e1b-f597-4725-ab8b-dafe1210ef96 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:54 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-79651e1b-f597-4725-ab8b-dafe1210ef96 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:54 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-79651e1b-f597-4725-ab8b-dafe1210ef96 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:54 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-79651e1b-f597-4725-ab8b-dafe1210ef96 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:54 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-79651e1b-f597-4725-ab8b-dafe1210ef96 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:55 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-00beb8bb-7418-4c99-93bb-695f28454614 req-f56858d3-f53b-47bc-84d9-604f1717bf22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b25948f-1d8c-4058-b3ed-8dca864de019", "name": "network-vif-unplugged", "status": "completed", "tag": "867014ca-c57c-49c8-ae22-275899767873"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:32:55 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-79651e1b-f597-4725-ab8b-dafe1210ef96 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b209357fca7f40c0b52507a285e054e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312c2b6e41142799cb66dd1377558d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:32:55 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-00beb8bb-7418-4c99-93bb-695f28454614 req-f56858d3-f53b-47bc-84d9-604f1717bf22 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:55 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-00beb8bb-7418-4c99-93bb-695f28454614 req-f56858d3-f53b-47bc-84d9-604f1717bf22 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:55 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-00beb8bb-7418-4c99-93bb-695f28454614 req-f56858d3-f53b-47bc-84d9-604f1717bf22 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:55 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-79651e1b-f597-4725-ab8b-dafe1210ef96 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019" status: 200 len: 1499 microversion: 2.1 time: 0.391068 Apr 18 14:32:55 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 61/187] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:54 2023] GET /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019 => generated 1499 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:32:55 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-00beb8bb-7418-4c99-93bb-695f28454614 req-f56858d3-f53b-47bc-84d9-604f1717bf22 service nova] Creating event network-vif-unplugged:867014ca-c57c-49c8-ae22-275899767873 for instance 1b25948f-1d8c-4058-b3ed-8dca864de019 on user Apr 18 14:32:55 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-00beb8bb-7418-4c99-93bb-695f28454614 req-f56858d3-f53b-47bc-84d9-604f1717bf22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030988 Apr 18 14:32:55 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 64/188] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:32:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:32:56 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-0cb6b9eb-6305-4382-908d-a300c87b639d req-5cc6c2a7-01fc-438b-b894-9b4e3257bd75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b25948f-1d8c-4058-b3ed-8dca864de019", "name": "network-vif-deleted", "tag": "867014ca-c57c-49c8-ae22-275899767873"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:32:56 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0cb6b9eb-6305-4382-908d-a300c87b639d req-5cc6c2a7-01fc-438b-b894-9b4e3257bd75 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:56 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0cb6b9eb-6305-4382-908d-a300c87b639d req-5cc6c2a7-01fc-438b-b894-9b4e3257bd75 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:56 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0cb6b9eb-6305-4382-908d-a300c87b639d req-5cc6c2a7-01fc-438b-b894-9b4e3257bd75 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:56 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-0cb6b9eb-6305-4382-908d-a300c87b639d req-5cc6c2a7-01fc-438b-b894-9b4e3257bd75 service nova] Creating event network-vif-deleted:867014ca-c57c-49c8-ae22-275899767873 for instance 1b25948f-1d8c-4058-b3ed-8dca864de019 on user Apr 18 14:32:56 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-0cb6b9eb-6305-4382-908d-a300c87b639d req-5cc6c2a7-01fc-438b-b894-9b4e3257bd75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032105 Apr 18 14:32:56 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 64/189] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:32:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:32:56 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-41586b96-4cae-462e-a9e9-fbfc6a93235e tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:32:56 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-41586b96-4cae-462e-a9e9-fbfc6a93235e tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 1fbf9e3f-365b-4749-8591-158ad177793f] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:32:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-41586b96-4cae-462e-a9e9-fbfc6a93235e tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-41586b96-4cae-462e-a9e9-fbfc6a93235e tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-41586b96-4cae-462e-a9e9-fbfc6a93235e tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-41586b96-4cae-462e-a9e9-fbfc6a93235e tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-41586b96-4cae-462e-a9e9-fbfc6a93235e tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-41586b96-4cae-462e-a9e9-fbfc6a93235e tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:57 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-41586b96-4cae-462e-a9e9-fbfc6a93235e tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b9b392cafe4b58b429be8e010baa08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88dd648f400c48f384c828c3933baa5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:32:57 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-41586b96-4cae-462e-a9e9-fbfc6a93235e tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f" status: 200 len: 1537 microversion: 2.1 time: 0.296554 Apr 18 14:32:57 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 62/190] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:32:56 2023] GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f => generated 1537 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:32:57 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-0f036045-90e5-4107-a674-8a76f541ab15 req-dfba9707-13aa-49df-9802-4c332aaea634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b25948f-1d8c-4058-b3ed-8dca864de019", "name": "network-vif-plugged", "status": "completed", "tag": "867014ca-c57c-49c8-ae22-275899767873"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:32:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-0f036045-90e5-4107-a674-8a76f541ab15 req-dfba9707-13aa-49df-9802-4c332aaea634 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:32:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-0f036045-90e5-4107-a674-8a76f541ab15 req-dfba9707-13aa-49df-9802-4c332aaea634 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:32:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-0f036045-90e5-4107-a674-8a76f541ab15 req-dfba9707-13aa-49df-9802-4c332aaea634 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:32:57 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-0f036045-90e5-4107-a674-8a76f541ab15 req-dfba9707-13aa-49df-9802-4c332aaea634 service nova] Creating event network-vif-plugged:867014ca-c57c-49c8-ae22-275899767873 for instance 1b25948f-1d8c-4058-b3ed-8dca864de019 on user Apr 18 14:32:57 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-0f036045-90e5-4107-a674-8a76f541ab15 req-dfba9707-13aa-49df-9802-4c332aaea634 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027432 Apr 18 14:32:57 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 65/191] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:32:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:08 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:08 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:08 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-b4a5d74b-d411-4726-bcf9-79e05d402359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:08 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-b4a5d74b-d411-4726-bcf9-79e05d402359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b4a5d74b-d411-4726-bcf9-79e05d402359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b4a5d74b-d411-4726-bcf9-79e05d402359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b4a5d74b-d411-4726-bcf9-79e05d402359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b4a5d74b-d411-4726-bcf9-79e05d402359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b4a5d74b-d411-4726-bcf9-79e05d402359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b4a5d74b-d411-4726-bcf9-79e05d402359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:08 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-b4a5d74b-d411-4726-bcf9-79e05d402359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:33:08 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-b4a5d74b-d411-4726-bcf9-79e05d402359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1656 microversion: 2.1 time: 0.270383 Apr 18 14:33:08 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 65/192] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:33:08 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1656 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:33:13 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:13 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=14 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:13 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-2c4b33b3-b47e-49ff-a5b3-a9e097dc2379 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Action: 'create', calling method: .version_select at 0x7f5cee94d5a0>, body: {"keypair": {"name": "tempest-keypair-2010940465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBD+sUJ0sokjz4Sl0bs67hRf8YuQ5lg+QPDbjZhNZknJMWma5VCyBcNu4sv41MyDB3U8wR9cn/dX4EpRGCs4ez9xN468gvhdW3vK4VcThferOXsExR25Cn9dkZEI3oXOmw=="}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:13 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-2c4b33b3-b47e-49ff-a5b3-a9e097dc2379 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Getting quotas for project e5667da319fd405e96f277368203a72b. Resources: {'key_pairs'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:33:13 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-2c4b33b3-b47e-49ff-a5b3-a9e097dc2379 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Getting quotas for user 53a60dd2a8ca42b391d4584accb60b4f and project e5667da319fd405e96f277368203a72b. Resources: {'key_pairs'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:33:13 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-2c4b33b3-b47e-49ff-a5b3-a9e097dc2379 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.151483 Apr 18 14:33:13 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 63/193] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:33:13 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=10 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1644080869", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "networks": [{"uuid": "f0359a19-919f-4ba1-a5a0-dc0779c0a773"}], "security_groups": [{"name": "tempest-securitygroup--1914962106"}], "key_name": "tempest-keypair-2010940465", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG nova.network.neutron [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] validate_networks() for [('f0359a19-919f-4ba1-a5a0-dc0779c0a773', None, None, None, None, None)] {{(pid=61310) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Flavor limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Image limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Flavor pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Image pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Getting quotas for project e5667da319fd405e96f277368203a72b. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Getting quotas for user 53a60dd2a8ca42b391d4584accb60b4f and project e5667da319fd405e96f277368203a72b. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Going to run 1 instances... {{(pid=61310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:33:15 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] [instance: 6795fad9-3f0a-430b-8319-a3c6025122c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:33:15 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-7177c8ae-1335-4c6a-bf0c-e5f4d1cb2902 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.615067 Apr 18 14:33:15 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 66/194] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:33:15 2023] POST /compute/v2.1/servers => generated 404 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:33:15 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-cb31788e-cf77-47b0-a5a9-e921367cd123 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:15 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-cb31788e-cf77-47b0-a5a9-e921367cd123 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] [instance: 6795fad9-3f0a-430b-8319-a3c6025122c3] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:15 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-cb31788e-cf77-47b0-a5a9-e921367cd123 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53a60dd2a8ca42b391d4584accb60b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5667da319fd405e96f277368203a72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:33:15 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-cb31788e-cf77-47b0-a5a9-e921367cd123 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3" status: 200 len: 1240 microversion: 2.1 time: 0.068187 Apr 18 14:33:15 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 66/195] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:33:15 2023] GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:33:18 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-bf6dfaf6-c361-459c-a41b-b63c77247f11 req-33dd6ae1-caf1-49bc-8d96-449b3376fff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6795fad9-3f0a-430b-8319-a3c6025122c3", "tag": "e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:18 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-bf6dfaf6-c361-459c-a41b-b63c77247f11 req-33dd6ae1-caf1-49bc-8d96-449b3376fff5 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:18 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-bf6dfaf6-c361-459c-a41b-b63c77247f11 req-33dd6ae1-caf1-49bc-8d96-449b3376fff5 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:18 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-bf6dfaf6-c361-459c-a41b-b63c77247f11 req-33dd6ae1-caf1-49bc-8d96-449b3376fff5 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:18 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-bf6dfaf6-c361-459c-a41b-b63c77247f11 req-33dd6ae1-caf1-49bc-8d96-449b3376fff5 service nova] Creating event network-changed:e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d for instance 6795fad9-3f0a-430b-8319-a3c6025122c3 on user Apr 18 14:33:18 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-bf6dfaf6-c361-459c-a41b-b63c77247f11 req-33dd6ae1-caf1-49bc-8d96-449b3376fff5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027560 Apr 18 14:33:18 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 64/196] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:20 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-f1bb88ae-d8bd-4d7f-a77b-b043d6d561eb req-e3efadf5-3a3d-4288-81e0-616e94c64585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6795fad9-3f0a-430b-8319-a3c6025122c3", "name": "network-vif-plugged", "status": "completed", "tag": "e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:20 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-f1bb88ae-d8bd-4d7f-a77b-b043d6d561eb req-e3efadf5-3a3d-4288-81e0-616e94c64585 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:20 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-f1bb88ae-d8bd-4d7f-a77b-b043d6d561eb req-e3efadf5-3a3d-4288-81e0-616e94c64585 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:20 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-f1bb88ae-d8bd-4d7f-a77b-b043d6d561eb req-e3efadf5-3a3d-4288-81e0-616e94c64585 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:20 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-f1bb88ae-d8bd-4d7f-a77b-b043d6d561eb req-e3efadf5-3a3d-4288-81e0-616e94c64585 service nova] Creating event network-vif-plugged:e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d for instance 6795fad9-3f0a-430b-8319-a3c6025122c3 on user Apr 18 14:33:20 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-f1bb88ae-d8bd-4d7f-a77b-b043d6d561eb req-e3efadf5-3a3d-4288-81e0-616e94c64585 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061106 Apr 18 14:33:20 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 67/197] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:20 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-14340938-af95-456e-9956-1dd5f074e5e6 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:20 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-14340938-af95-456e-9956-1dd5f074e5e6 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: 2bee7710-8a40-47bc-89b7-f0cf4def19b3] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:20 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-14340938-af95-456e-9956-1dd5f074e5e6 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-14340938-af95-456e-9956-1dd5f074e5e6 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-14340938-af95-456e-9956-1dd5f074e5e6 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-14340938-af95-456e-9956-1dd5f074e5e6 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-14340938-af95-456e-9956-1dd5f074e5e6 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-14340938-af95-456e-9956-1dd5f074e5e6 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:20 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-14340938-af95-456e-9956-1dd5f074e5e6 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] HTTP exception thrown: Instance 2bee7710-8a40-47bc-89b7-f0cf4def19b3 could not be found. Apr 18 14:33:20 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-14340938-af95-456e-9956-1dd5f074e5e6 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Request method failure captured: Apr 18 14:33:20 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3 HTTP/1.1 Apr 18 14:33:20 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:33:20 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:33:20 user devstack@n-api.service[61309]: Connection: close Apr 18 14:33:20 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:33:20 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:33:20 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:33:20 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:33:20 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqmBOREvdVgPkeex88b6G1mE0T-WeIfcK2Yw4ktTbC8cwlwIyUW_455k9l0o-gl0OltznbJr03B8n5RpGVc3KqqU2vleLyOY6N5iiuCY-jd_TjNym8h-WI1RTb2uAcBQcffjKXv3xJbFmm78CjDXXqsWSezvbsn20r95GrvPKmuwuSQ Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Project-Id: 37b30ff7e42a496fa0abfb7102e9c0b8 Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Project-Name: tempest-TestMinimumBasicScenario-317059403 Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b30ff7e42a496fa0abfb7102e9c0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b30ff7e42a496fa0abfb7102e9c0b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b30ff7e42a496fa0abfb7102e9c0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Tenant: tempest-TestMinimumBasicScenario-317059403 Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Tenant-Id: 37b30ff7e42a496fa0abfb7102e9c0b8 Apr 18 14:33:20 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-TestMinimumBasicScenario-317059403 Apr 18 14:33:20 user devstack@n-api.service[61309]: X-User: tempest-TestMinimumBasicScenario-317059403-project-member Apr 18 14:33:20 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:33:20 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:33:20 user devstack@n-api.service[61309]: X-User-Id: 6ae2d60ff00f4be59827e15aece5d8c4 Apr 18 14:33:20 user devstack@n-api.service[61309]: X-User-Name: tempest-TestMinimumBasicScenario-317059403-project-member Apr 18 14:33:20 user devstack@n-api.service[61309]: method: > Apr 18 14:33:20 user devstack@n-api.service[61309]: exception: Instance 2bee7710-8a40-47bc-89b7-f0cf4def19b3 could not be found. Apr 18 14:33:20 user devstack@n-api.service[61309]: action_args: {'id': '2bee7710-8a40-47bc-89b7-f0cf4def19b3'} Apr 18 14:33:20 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bee7710-8a40-47bc-89b7-f0cf4def19b3 could not be found. Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bee7710-8a40-47bc-89b7-f0cf4def19b3 could not be found. Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bee7710-8a40-47bc-89b7-f0cf4def19b3 could not be found. Apr 18 14:33:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:33:20 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-14340938-af95-456e-9956-1dd5f074e5e6 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Returning 404 to user: Instance 2bee7710-8a40-47bc-89b7-f0cf4def19b3 could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:33:20 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-14340938-af95-456e-9956-1dd5f074e5e6 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3" status: 404 len: 111 microversion: 2.1 time: 0.059619 Apr 18 14:33:20 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 67/198] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:33:20 2023] GET /compute/v2.1/servers/2bee7710-8a40-47bc-89b7-f0cf4def19b3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:33:20 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-a4ee81a4-b774-434f-85d3-d260bfcccade tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '.version_select at 0x7f5ceea8e950>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:20 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-a4ee81a4-b774-434f-85d3-d260bfcccade tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1401672297" status: 202 len: 0 microversion: 2.1 time: 0.022665 Apr 18 14:33:20 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 65/199] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 18 14:33:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1401672297 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:33:22 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-78f765de-3a19-4f36-8d69-c6fe2b20008f req-8ead069d-93a3-4155-b2c8-9670825e30f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6795fad9-3f0a-430b-8319-a3c6025122c3", "name": "network-vif-plugged", "status": "completed", "tag": "e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-78f765de-3a19-4f36-8d69-c6fe2b20008f req-8ead069d-93a3-4155-b2c8-9670825e30f6 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-78f765de-3a19-4f36-8d69-c6fe2b20008f req-8ead069d-93a3-4155-b2c8-9670825e30f6 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:22 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-78f765de-3a19-4f36-8d69-c6fe2b20008f req-8ead069d-93a3-4155-b2c8-9670825e30f6 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:22 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-78f765de-3a19-4f36-8d69-c6fe2b20008f req-8ead069d-93a3-4155-b2c8-9670825e30f6 service nova] Creating event network-vif-plugged:e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d for instance 6795fad9-3f0a-430b-8319-a3c6025122c3 on user Apr 18 14:33:22 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-78f765de-3a19-4f36-8d69-c6fe2b20008f req-8ead069d-93a3-4155-b2c8-9670825e30f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028900 Apr 18 14:33:22 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 68/200] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:22 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-171e17cf-2d36-4d09-8599-fe53204afffa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Action: 'create', calling method: .version_select at 0x7f5ceeaebf40>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-68293471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvPVWEVZ3QVvaQ/JloSpOqkmksb3FC8sR9eC5cz+U1/SxlqHa3H2YrWBe53g24/LNx+mMIvupfZjH/XaJkvoxF8NUdL03NvLxNWIJHFgGdUP+lZXI6f9h0iVERt+LLMRA=="}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:22 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-171e17cf-2d36-4d09-8599-fe53204afffa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Getting quotas for project 37b30ff7e42a496fa0abfb7102e9c0b8. Resources: {'key_pairs'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:33:22 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-171e17cf-2d36-4d09-8599-fe53204afffa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Getting quotas for user 6ae2d60ff00f4be59827e15aece5d8c4 and project 37b30ff7e42a496fa0abfb7102e9c0b8. Resources: {'key_pairs'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:33:22 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-171e17cf-2d36-4d09-8599-fe53204afffa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.101884 Apr 18 14:33:22 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 68/201] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:33:22 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1851182937", "imageRef": "6150ed4c-70a5-4d8f-a1a5-8157805c1353", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-68293471", "networks": [{"uuid": "15f69a51-bdb4-419b-ab40-87648b533468"}]}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG nova.network.neutron [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] validate_networks() for [('15f69a51-bdb4-419b-ab40-87648b533468', None, None, None, None, None)] {{(pid=61311) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Flavor limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Image limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Flavor pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Image pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Getting quotas for project 37b30ff7e42a496fa0abfb7102e9c0b8. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Getting quotas for user 6ae2d60ff00f4be59827e15aece5d8c4 and project 37b30ff7e42a496fa0abfb7102e9c0b8. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Going to run 1 instances... {{(pid=61311) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:33:23 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: b6a78d1f-313b-4957-8a3f-75244b0b242f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6150ed4c-70a5-4d8f-a1a5-8157805c1353',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:33:23 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-5848a5c1-8640-4d14-a625-b0a83108b3ad tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.666998 Apr 18 14:33:23 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 66/202] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:33:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:33:23 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-98124e22-57f2-4b29-8b8d-fefaaf4acb81 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:23 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-98124e22-57f2-4b29-8b8d-fefaaf4acb81 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: b6a78d1f-313b-4957-8a3f-75244b0b242f] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:23 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-98124e22-57f2-4b29-8b8d-fefaaf4acb81 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae2d60ff00f4be59827e15aece5d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:33:23 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-98124e22-57f2-4b29-8b8d-fefaaf4acb81 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f" status: 200 len: 1251 microversion: 2.1 time: 0.065398 Apr 18 14:33:23 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 69/203] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:33:23 2023] GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f => generated 1251 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:33:26 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-85245407-e6b4-4c15-959b-dc83a5ba8599 req-803d007f-6641-4b8d-be14-d1189705dead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a78d1f-313b-4957-8a3f-75244b0b242f", "tag": "05bb8b6c-a9cd-4476-86f7-66825eefc586"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:26 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-85245407-e6b4-4c15-959b-dc83a5ba8599 req-803d007f-6641-4b8d-be14-d1189705dead service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:26 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-85245407-e6b4-4c15-959b-dc83a5ba8599 req-803d007f-6641-4b8d-be14-d1189705dead service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:26 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-85245407-e6b4-4c15-959b-dc83a5ba8599 req-803d007f-6641-4b8d-be14-d1189705dead service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:26 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-85245407-e6b4-4c15-959b-dc83a5ba8599 req-803d007f-6641-4b8d-be14-d1189705dead service nova] Creating event network-changed:05bb8b6c-a9cd-4476-86f7-66825eefc586 for instance b6a78d1f-313b-4957-8a3f-75244b0b242f on user Apr 18 14:33:26 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-85245407-e6b4-4c15-959b-dc83a5ba8599 req-803d007f-6641-4b8d-be14-d1189705dead service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052078 Apr 18 14:33:26 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 69/204] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:28 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-38fae600-3d7a-4ed0-a4cd-9ef489b40119 req-b5b5bdb5-c83e-4d7e-9485-17eac72d0a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a78d1f-313b-4957-8a3f-75244b0b242f", "name": "network-vif-plugged", "status": "completed", "tag": "05bb8b6c-a9cd-4476-86f7-66825eefc586"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-38fae600-3d7a-4ed0-a4cd-9ef489b40119 req-b5b5bdb5-c83e-4d7e-9485-17eac72d0a31 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-38fae600-3d7a-4ed0-a4cd-9ef489b40119 req-b5b5bdb5-c83e-4d7e-9485-17eac72d0a31 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-38fae600-3d7a-4ed0-a4cd-9ef489b40119 req-b5b5bdb5-c83e-4d7e-9485-17eac72d0a31 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:29 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-38fae600-3d7a-4ed0-a4cd-9ef489b40119 req-b5b5bdb5-c83e-4d7e-9485-17eac72d0a31 service nova] Creating event network-vif-plugged:05bb8b6c-a9cd-4476-86f7-66825eefc586 for instance b6a78d1f-313b-4957-8a3f-75244b0b242f on user Apr 18 14:33:29 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-38fae600-3d7a-4ed0-a4cd-9ef489b40119 req-b5b5bdb5-c83e-4d7e-9485-17eac72d0a31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028514 Apr 18 14:33:29 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 67/205] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:30 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-d5a568db-5fff-4908-80e7-47661a55b2ed tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:30 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-d5a568db-5fff-4908-80e7-47661a55b2ed tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 38b44765-7b1f-449a-bd4d-99d1df340ba4] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:30 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-d5a568db-5fff-4908-80e7-47661a55b2ed tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-d5a568db-5fff-4908-80e7-47661a55b2ed tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-d5a568db-5fff-4908-80e7-47661a55b2ed tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-d5a568db-5fff-4908-80e7-47661a55b2ed tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-d5a568db-5fff-4908-80e7-47661a55b2ed tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-d5a568db-5fff-4908-80e7-47661a55b2ed tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:30 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-d5a568db-5fff-4908-80e7-47661a55b2ed tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 38b44765-7b1f-449a-bd4d-99d1df340ba4] Going to try to terminate instance {{(pid=61310) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:33:30 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-d5a568db-5fff-4908-80e7-47661a55b2ed tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/38b44765-7b1f-449a-bd4d-99d1df340ba4" status: 204 len: 0 microversion: 2.1 time: 0.113375 Apr 18 14:33:30 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 70/206] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:33:30 2023] DELETE /compute/v2.1/servers/38b44765-7b1f-449a-bd4d-99d1df340ba4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:33:30 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-50b82b20-2dd9-43b3-85c4-55a7fc7322c2 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:30 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-50b82b20-2dd9-43b3-85c4-55a7fc7322c2 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 38b44765-7b1f-449a-bd4d-99d1df340ba4] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-50b82b20-2dd9-43b3-85c4-55a7fc7322c2 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-50b82b20-2dd9-43b3-85c4-55a7fc7322c2 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-50b82b20-2dd9-43b3-85c4-55a7fc7322c2 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-50b82b20-2dd9-43b3-85c4-55a7fc7322c2 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-50b82b20-2dd9-43b3-85c4-55a7fc7322c2 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-50b82b20-2dd9-43b3-85c4-55a7fc7322c2 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:30 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-44b55c3b-6741-4bcf-ba82-e7fa7aacff18 req-69891556-3a74-4c49-a27c-6781f7535e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b44765-7b1f-449a-bd4d-99d1df340ba4", "name": "network-vif-unplugged", "status": "completed", "tag": "969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:30 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-50b82b20-2dd9-43b3-85c4-55a7fc7322c2 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039b3016f884a42abcb58054d649cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1e17fb95d64cae9c6c210d143d115b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:33:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-44b55c3b-6741-4bcf-ba82-e7fa7aacff18 req-69891556-3a74-4c49-a27c-6781f7535e7a service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-44b55c3b-6741-4bcf-ba82-e7fa7aacff18 req-69891556-3a74-4c49-a27c-6781f7535e7a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-44b55c3b-6741-4bcf-ba82-e7fa7aacff18 req-69891556-3a74-4c49-a27c-6781f7535e7a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:30 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-50b82b20-2dd9-43b3-85c4-55a7fc7322c2 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38b44765-7b1f-449a-bd4d-99d1df340ba4" status: 200 len: 1501 microversion: 2.1 time: 0.265161 Apr 18 14:33:30 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 70/207] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:33:30 2023] GET /compute/v2.1/servers/38b44765-7b1f-449a-bd4d-99d1df340ba4 => generated 1501 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:33:30 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-44b55c3b-6741-4bcf-ba82-e7fa7aacff18 req-69891556-3a74-4c49-a27c-6781f7535e7a service nova] Creating event network-vif-unplugged:969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b for instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 on user Apr 18 14:33:30 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-44b55c3b-6741-4bcf-ba82-e7fa7aacff18 req-69891556-3a74-4c49-a27c-6781f7535e7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032036 Apr 18 14:33:30 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 68/208] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:31 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-996829ce-d8d6-4031-a9e6-a72279905855 req-9ba87158-5c02-4988-b0f5-f5ed43a1ccae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a78d1f-313b-4957-8a3f-75244b0b242f", "name": "network-vif-plugged", "status": "completed", "tag": "05bb8b6c-a9cd-4476-86f7-66825eefc586"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:31 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-996829ce-d8d6-4031-a9e6-a72279905855 req-9ba87158-5c02-4988-b0f5-f5ed43a1ccae service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:31 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-996829ce-d8d6-4031-a9e6-a72279905855 req-9ba87158-5c02-4988-b0f5-f5ed43a1ccae service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:31 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-996829ce-d8d6-4031-a9e6-a72279905855 req-9ba87158-5c02-4988-b0f5-f5ed43a1ccae service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:31 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-996829ce-d8d6-4031-a9e6-a72279905855 req-9ba87158-5c02-4988-b0f5-f5ed43a1ccae service nova] Creating event network-vif-plugged:05bb8b6c-a9cd-4476-86f7-66825eefc586 for instance b6a78d1f-313b-4957-8a3f-75244b0b242f on user Apr 18 14:33:31 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-996829ce-d8d6-4031-a9e6-a72279905855 req-9ba87158-5c02-4988-b0f5-f5ed43a1ccae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040002 Apr 18 14:33:31 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 71/209] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:32 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-205a98cf-286f-4724-871e-098767af7988 req-7610c695-f1d5-4220-8ed4-cb51e38e00d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b44765-7b1f-449a-bd4d-99d1df340ba4", "name": "network-vif-plugged", "status": "completed", "tag": "969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b"}, {"server_uuid": "38b44765-7b1f-449a-bd4d-99d1df340ba4", "name": "network-vif-plugged", "status": "completed", "tag": "969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b"}, {"server_uuid": "38b44765-7b1f-449a-bd4d-99d1df340ba4", "name": "network-vif-plugged", "status": "completed", "tag": "969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b"}, {"server_uuid": "38b44765-7b1f-449a-bd4d-99d1df340ba4", "name": "network-vif-unplugged", "status": "completed", "tag": "969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b"}, {"server_uuid": "38b44765-7b1f-449a-bd4d-99d1df340ba4", "name": "network-vif-plugged", "status": "completed", "tag": "969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:32 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-205a98cf-286f-4724-871e-098767af7988 req-7610c695-f1d5-4220-8ed4-cb51e38e00d5 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:32 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-205a98cf-286f-4724-871e-098767af7988 req-7610c695-f1d5-4220-8ed4-cb51e38e00d5 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:32 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-205a98cf-286f-4724-871e-098767af7988 req-7610c695-f1d5-4220-8ed4-cb51e38e00d5 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:32 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-205a98cf-286f-4724-871e-098767af7988 req-7610c695-f1d5-4220-8ed4-cb51e38e00d5 service nova] Creating event network-vif-plugged:969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b for instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 on user Apr 18 14:33:32 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-205a98cf-286f-4724-871e-098767af7988 req-7610c695-f1d5-4220-8ed4-cb51e38e00d5 service nova] Creating event network-vif-plugged:969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b for instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 on user Apr 18 14:33:32 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-205a98cf-286f-4724-871e-098767af7988 req-7610c695-f1d5-4220-8ed4-cb51e38e00d5 service nova] Creating event network-vif-plugged:969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b for instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 on user Apr 18 14:33:32 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-205a98cf-286f-4724-871e-098767af7988 req-7610c695-f1d5-4220-8ed4-cb51e38e00d5 service nova] Creating event network-vif-unplugged:969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b for instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 on user Apr 18 14:33:32 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-205a98cf-286f-4724-871e-098767af7988 req-7610c695-f1d5-4220-8ed4-cb51e38e00d5 service nova] Creating event network-vif-plugged:969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b for instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 on user Apr 18 14:33:32 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-205a98cf-286f-4724-871e-098767af7988 req-7610c695-f1d5-4220-8ed4-cb51e38e00d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032885 Apr 18 14:33:32 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 71/210] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:32 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 14:33:33 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-5a2eb964-e06b-4385-9a51-df6d115e1b9a req-3c67b2f9-ef09-46a5-a8d4-ed85a0ec95f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b44765-7b1f-449a-bd4d-99d1df340ba4", "name": "network-vif-deleted", "tag": "969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:33 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-5a2eb964-e06b-4385-9a51-df6d115e1b9a req-3c67b2f9-ef09-46a5-a8d4-ed85a0ec95f8 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:33 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-5a2eb964-e06b-4385-9a51-df6d115e1b9a req-3c67b2f9-ef09-46a5-a8d4-ed85a0ec95f8 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:33 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-5a2eb964-e06b-4385-9a51-df6d115e1b9a req-3c67b2f9-ef09-46a5-a8d4-ed85a0ec95f8 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:33 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-5a2eb964-e06b-4385-9a51-df6d115e1b9a req-3c67b2f9-ef09-46a5-a8d4-ed85a0ec95f8 service nova] Creating event network-vif-deleted:969c9d6e-0002-4dc1-b5bf-dd54c5af3a9b for instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 on user Apr 18 14:33:33 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-5a2eb964-e06b-4385-9a51-df6d115e1b9a req-3c67b2f9-ef09-46a5-a8d4-ed85a0ec95f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031344 Apr 18 14:33:33 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 69/211] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=8 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-8bb7e86f-f215-43a5-837d-11fa82576851 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-8bb7e86f-f215-43a5-837d-11fa82576851 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: 1b25948f-1d8c-4058-b3ed-8dca864de019] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8bb7e86f-f215-43a5-837d-11fa82576851 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8bb7e86f-f215-43a5-837d-11fa82576851 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8bb7e86f-f215-43a5-837d-11fa82576851 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8bb7e86f-f215-43a5-837d-11fa82576851 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8bb7e86f-f215-43a5-837d-11fa82576851 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8bb7e86f-f215-43a5-837d-11fa82576851 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:45 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-8bb7e86f-f215-43a5-837d-11fa82576851 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] HTTP exception thrown: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-8bb7e86f-f215-43a5-837d-11fa82576851 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Request method failure captured: Apr 18 14:33:45 user devstack@n-api.service[61310]: request: GET /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019 HTTP/1.1 Apr 18 14:33:45 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:33:45 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:33:45 user devstack@n-api.service[61310]: Connection: close Apr 18 14:33:45 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:33:45 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:33:45 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:33:45 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:33:45 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqk01BOvVmbB2Ieo9eow9OsPXEa8j7QHz28HDii3x0B-sbBWerJe8bp-cIIrFClR5xWbKKrDLUPVmvc18B44p7hZxOj_wUba2spIm_6jNZqszskDdyKBp0g7AflgpDk4aezgROrfADu6LT_Z2GK_PlFoUnNpbMuYdApcgMNnio5a8iI Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Project-Id: 3312c2b6e41142799cb66dd1377558d8 Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Project-Name: tempest-ServersNegativeTestJSON-1865061463 Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3312c2b6e41142799cb66dd1377558d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3312c2b6e41142799cb66dd1377558d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3312c2b6e41142799cb66dd1377558d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Tenant: tempest-ServersNegativeTestJSON-1865061463 Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Tenant-Id: 3312c2b6e41142799cb66dd1377558d8 Apr 18 14:33:45 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1865061463 Apr 18 14:33:45 user devstack@n-api.service[61310]: X-User: tempest-ServersNegativeTestJSON-1865061463-project-member Apr 18 14:33:45 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:33:45 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:33:45 user devstack@n-api.service[61310]: X-User-Id: b209357fca7f40c0b52507a285e054e3 Apr 18 14:33:45 user devstack@n-api.service[61310]: X-User-Name: tempest-ServersNegativeTestJSON-1865061463-project-member Apr 18 14:33:45 user devstack@n-api.service[61310]: method: > Apr 18 14:33:45 user devstack@n-api.service[61310]: exception: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:33:45 user devstack@n-api.service[61310]: action_args: {'id': '1b25948f-1d8c-4058-b3ed-8dca864de019'} Apr 18 14:33:45 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:33:45 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:33:45 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-8bb7e86f-f215-43a5-837d-11fa82576851 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Returning 404 to user: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:33:45 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-8bb7e86f-f215-43a5-837d-11fa82576851 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019" status: 404 len: 111 microversion: 2.1 time: 0.053512 Apr 18 14:33:45 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 72/212] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:33:45 2023] GET /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:33:45 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:45 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:45 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=12 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:45 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-408104ad-f4f0-4322-9ad9-50861bec3709 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:45 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-408104ad-f4f0-4322-9ad9-50861bec3709 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: e5323297-c840-4fd6-9a76-727ed36de870] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:45 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-408104ad-f4f0-4322-9ad9-50861bec3709 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:45 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-408104ad-f4f0-4322-9ad9-50861bec3709 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:45 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-408104ad-f4f0-4322-9ad9-50861bec3709 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:45 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-408104ad-f4f0-4322-9ad9-50861bec3709 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:45 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-408104ad-f4f0-4322-9ad9-50861bec3709 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:45 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-408104ad-f4f0-4322-9ad9-50861bec3709 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:45 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-408104ad-f4f0-4322-9ad9-50861bec3709 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b209357fca7f40c0b52507a285e054e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312c2b6e41142799cb66dd1377558d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:33:45 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-408104ad-f4f0-4322-9ad9-50861bec3709 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870" status: 200 len: 1493 microversion: 2.1 time: 0.365258 Apr 18 14:33:45 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 72/213] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:33:45 2023] GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870 => generated 1493 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=10 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-1ab9e0f1-201f-4671-a91b-f6f437eebec6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-1ab9e0f1-201f-4671-a91b-f6f437eebec6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 909db006-c38d-4b50-acaa-4224aed6ea45] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-1ab9e0f1-201f-4671-a91b-f6f437eebec6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-1ab9e0f1-201f-4671-a91b-f6f437eebec6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-1ab9e0f1-201f-4671-a91b-f6f437eebec6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-1ab9e0f1-201f-4671-a91b-f6f437eebec6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-1ab9e0f1-201f-4671-a91b-f6f437eebec6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-1ab9e0f1-201f-4671-a91b-f6f437eebec6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:56 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-1ab9e0f1-201f-4671-a91b-f6f437eebec6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 909db006-c38d-4b50-acaa-4224aed6ea45] Going to try to terminate instance {{(pid=61311) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:33:56 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-1ab9e0f1-201f-4671-a91b-f6f437eebec6 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45" status: 204 len: 0 microversion: 2.1 time: 0.135747 Apr 18 14:33:56 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 70/214] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:33:56 2023] DELETE /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:33:56 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-108d19d6-ca9a-4dcb-9f8f-045b10849175 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:56 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-108d19d6-ca9a-4dcb-9f8f-045b10849175 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 909db006-c38d-4b50-acaa-4224aed6ea45] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:56 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:56 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:56 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-108d19d6-ca9a-4dcb-9f8f-045b10849175 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:56 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-108d19d6-ca9a-4dcb-9f8f-045b10849175 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:56 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-108d19d6-ca9a-4dcb-9f8f-045b10849175 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:56 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-108d19d6-ca9a-4dcb-9f8f-045b10849175 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:56 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-108d19d6-ca9a-4dcb-9f8f-045b10849175 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:56 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-108d19d6-ca9a-4dcb-9f8f-045b10849175 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:56 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-cc98df51-36c5-4372-a913-8570187ab656 req-bf232c7c-7142-4bb4-bd73-5ae8eaab2498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909db006-c38d-4b50-acaa-4224aed6ea45", "name": "network-vif-unplugged", "status": "completed", "tag": "f4b085c8-1069-40a4-8d8b-ebb5633472a6"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:56 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:56 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:33:56 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-cc98df51-36c5-4372-a913-8570187ab656 req-bf232c7c-7142-4bb4-bd73-5ae8eaab2498 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:56 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-cc98df51-36c5-4372-a913-8570187ab656 req-bf232c7c-7142-4bb4-bd73-5ae8eaab2498 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:56 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-cc98df51-36c5-4372-a913-8570187ab656 req-bf232c7c-7142-4bb4-bd73-5ae8eaab2498 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:56 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-108d19d6-ca9a-4dcb-9f8f-045b10849175 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e284b794c4043768af56fd58fceb837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ca11d8beec4410a8a4c8ae7c8e4bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:33:56 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-cc98df51-36c5-4372-a913-8570187ab656 req-bf232c7c-7142-4bb4-bd73-5ae8eaab2498 service nova] Creating event network-vif-unplugged:f4b085c8-1069-40a4-8d8b-ebb5633472a6 for instance 909db006-c38d-4b50-acaa-4224aed6ea45 on user Apr 18 14:33:56 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-108d19d6-ca9a-4dcb-9f8f-045b10849175 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45" status: 200 len: 1494 microversion: 2.1 time: 0.319287 Apr 18 14:33:56 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 73/215] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:33:56 2023] GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45 => generated 1494 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:33:56 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-cc98df51-36c5-4372-a913-8570187ab656 req-bf232c7c-7142-4bb4-bd73-5ae8eaab2498 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038498 Apr 18 14:33:56 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 73/216] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:57 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-8f7a1240-e9b9-4d96-9cf2-2da1c89b40c5 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:57 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-8f7a1240-e9b9-4d96-9cf2-2da1c89b40c5 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 1fbf9e3f-365b-4749-8591-158ad177793f] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-8f7a1240-e9b9-4d96-9cf2-2da1c89b40c5 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-8f7a1240-e9b9-4d96-9cf2-2da1c89b40c5 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-8f7a1240-e9b9-4d96-9cf2-2da1c89b40c5 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-8f7a1240-e9b9-4d96-9cf2-2da1c89b40c5 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-8f7a1240-e9b9-4d96-9cf2-2da1c89b40c5 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-8f7a1240-e9b9-4d96-9cf2-2da1c89b40c5 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:57 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-8f7a1240-e9b9-4d96-9cf2-2da1c89b40c5 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.214558 Apr 18 14:33:57 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 71/217] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 14:33:57 2023] GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f/os-interface => generated 283 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:57 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-ab446d4a-b957-4100-aff8-b78be505be8e req-22efabda-d470-4e02-9d6a-8290c0c813f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909db006-c38d-4b50-acaa-4224aed6ea45", "name": "network-vif-deleted", "tag": "f4b085c8-1069-40a4-8d8b-ebb5633472a6"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-ab446d4a-b957-4100-aff8-b78be505be8e req-22efabda-d470-4e02-9d6a-8290c0c813f1 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-ab446d4a-b957-4100-aff8-b78be505be8e req-22efabda-d470-4e02-9d6a-8290c0c813f1 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-ab446d4a-b957-4100-aff8-b78be505be8e req-22efabda-d470-4e02-9d6a-8290c0c813f1 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:57 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-ab446d4a-b957-4100-aff8-b78be505be8e req-22efabda-d470-4e02-9d6a-8290c0c813f1 service nova] Creating event network-vif-deleted:f4b085c8-1069-40a4-8d8b-ebb5633472a6 for instance 909db006-c38d-4b50-acaa-4224aed6ea45 on user Apr 18 14:33:57 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-ab446d4a-b957-4100-aff8-b78be505be8e req-22efabda-d470-4e02-9d6a-8290c0c813f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028273 Apr 18 14:33:57 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 74/218] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:58 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-33b05590-9d76-4a70-82ae-5c796b5020e8 req-8fe0df25-07d2-406f-8a2a-23291d54cde8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbf9e3f-365b-4749-8591-158ad177793f", "tag": "0abc5ad0-4c5b-4585-bdb1-88832e4974fd"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-33b05590-9d76-4a70-82ae-5c796b5020e8 req-8fe0df25-07d2-406f-8a2a-23291d54cde8 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-33b05590-9d76-4a70-82ae-5c796b5020e8 req-8fe0df25-07d2-406f-8a2a-23291d54cde8 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-33b05590-9d76-4a70-82ae-5c796b5020e8 req-8fe0df25-07d2-406f-8a2a-23291d54cde8 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:58 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-33b05590-9d76-4a70-82ae-5c796b5020e8 req-8fe0df25-07d2-406f-8a2a-23291d54cde8 service nova] Creating event network-changed:0abc5ad0-4c5b-4585-bdb1-88832e4974fd for instance 1fbf9e3f-365b-4749-8591-158ad177793f on user Apr 18 14:33:58 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-33b05590-9d76-4a70-82ae-5c796b5020e8 req-8fe0df25-07d2-406f-8a2a-23291d54cde8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028431 Apr 18 14:33:58 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 74/219] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:58 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-cf32f25a-7bc6-4581-97f2-cac904327630 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:58 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-cf32f25a-7bc6-4581-97f2-cac904327630 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 1fbf9e3f-365b-4749-8591-158ad177793f] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cf32f25a-7bc6-4581-97f2-cac904327630 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cf32f25a-7bc6-4581-97f2-cac904327630 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cf32f25a-7bc6-4581-97f2-cac904327630 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cf32f25a-7bc6-4581-97f2-cac904327630 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cf32f25a-7bc6-4581-97f2-cac904327630 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cf32f25a-7bc6-4581-97f2-cac904327630 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:58 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-cf32f25a-7bc6-4581-97f2-cac904327630 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f/ips" status: 200 len: 104 microversion: 2.1 time: 0.043752 Apr 18 14:33:58 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 72/220] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 14:33:58 2023] GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f/ips => generated 104 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:58 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-1939eb7b-aa5b-474a-89d1-9127e579c30b req-628bf1cf-e173-48cf-9a57-4e21e8107f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909db006-c38d-4b50-acaa-4224aed6ea45", "name": "network-vif-plugged", "status": "completed", "tag": "f4b085c8-1069-40a4-8d8b-ebb5633472a6"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:33:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-1939eb7b-aa5b-474a-89d1-9127e579c30b req-628bf1cf-e173-48cf-9a57-4e21e8107f01 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-1939eb7b-aa5b-474a-89d1-9127e579c30b req-628bf1cf-e173-48cf-9a57-4e21e8107f01 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-1939eb7b-aa5b-474a-89d1-9127e579c30b req-628bf1cf-e173-48cf-9a57-4e21e8107f01 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:58 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-1939eb7b-aa5b-474a-89d1-9127e579c30b req-628bf1cf-e173-48cf-9a57-4e21e8107f01 service nova] Creating event network-vif-plugged:f4b085c8-1069-40a4-8d8b-ebb5633472a6 for instance 909db006-c38d-4b50-acaa-4224aed6ea45 on user Apr 18 14:33:58 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-1939eb7b-aa5b-474a-89d1-9127e579c30b req-628bf1cf-e173-48cf-9a57-4e21e8107f01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028471 Apr 18 14:33:58 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 75/221] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:33:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:33:59 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-60ece7f9-64bf-49a8-8655-f613d0f85166 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:59 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-60ece7f9-64bf-49a8-8655-f613d0f85166 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 1fbf9e3f-365b-4749-8591-158ad177793f] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-60ece7f9-64bf-49a8-8655-f613d0f85166 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-60ece7f9-64bf-49a8-8655-f613d0f85166 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-60ece7f9-64bf-49a8-8655-f613d0f85166 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-60ece7f9-64bf-49a8-8655-f613d0f85166 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-60ece7f9-64bf-49a8-8655-f613d0f85166 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-60ece7f9-64bf-49a8-8655-f613d0f85166 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:59 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-60ece7f9-64bf-49a8-8655-f613d0f85166 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 1fbf9e3f-365b-4749-8591-158ad177793f] Going to try to terminate instance {{(pid=61309) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:33:59 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-60ece7f9-64bf-49a8-8655-f613d0f85166 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f" status: 204 len: 0 microversion: 2.1 time: 0.114921 Apr 18 14:33:59 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 75/222] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:33:59 2023] DELETE /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:33:59 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-00d6b2d0-7586-4777-a6da-fb087ae825bd tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:33:59 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-00d6b2d0-7586-4777-a6da-fb087ae825bd tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 1fbf9e3f-365b-4749-8591-158ad177793f] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:33:59 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-00d6b2d0-7586-4777-a6da-fb087ae825bd tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:59 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-00d6b2d0-7586-4777-a6da-fb087ae825bd tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:59 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-00d6b2d0-7586-4777-a6da-fb087ae825bd tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:33:59 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-00d6b2d0-7586-4777-a6da-fb087ae825bd tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:33:59 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-00d6b2d0-7586-4777-a6da-fb087ae825bd tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:33:59 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-00d6b2d0-7586-4777-a6da-fb087ae825bd tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:00 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-00d6b2d0-7586-4777-a6da-fb087ae825bd tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b9b392cafe4b58b429be8e010baa08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88dd648f400c48f384c828c3933baa5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:34:00 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-00d6b2d0-7586-4777-a6da-fb087ae825bd tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f" status: 200 len: 1662 microversion: 2.1 time: 0.213745 Apr 18 14:34:00 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 73/223] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:33:59 2023] GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f => generated 1662 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:34:00 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-b736b797-a2d7-4036-8edf-0432b0bdfc60 req-744ea3d4-02a7-493f-a6af-d18deaa270fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbf9e3f-365b-4749-8591-158ad177793f", "name": "network-vif-unplugged", "status": "completed", "tag": "0abc5ad0-4c5b-4585-bdb1-88832e4974fd"}, {"server_uuid": "1fbf9e3f-365b-4749-8591-158ad177793f", "name": "network-vif-plugged", "status": "completed", "tag": "0abc5ad0-4c5b-4585-bdb1-88832e4974fd"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:34:00 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-b736b797-a2d7-4036-8edf-0432b0bdfc60 req-744ea3d4-02a7-493f-a6af-d18deaa270fc service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:00 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-b736b797-a2d7-4036-8edf-0432b0bdfc60 req-744ea3d4-02a7-493f-a6af-d18deaa270fc service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:00 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-b736b797-a2d7-4036-8edf-0432b0bdfc60 req-744ea3d4-02a7-493f-a6af-d18deaa270fc service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:00 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-b736b797-a2d7-4036-8edf-0432b0bdfc60 req-744ea3d4-02a7-493f-a6af-d18deaa270fc service nova] Creating event network-vif-unplugged:0abc5ad0-4c5b-4585-bdb1-88832e4974fd for instance 1fbf9e3f-365b-4749-8591-158ad177793f on user Apr 18 14:34:00 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-b736b797-a2d7-4036-8edf-0432b0bdfc60 req-744ea3d4-02a7-493f-a6af-d18deaa270fc service nova] Creating event network-vif-plugged:0abc5ad0-4c5b-4585-bdb1-88832e4974fd for instance 1fbf9e3f-365b-4749-8591-158ad177793f on user Apr 18 14:34:00 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-b736b797-a2d7-4036-8edf-0432b0bdfc60 req-744ea3d4-02a7-493f-a6af-d18deaa270fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030349 Apr 18 14:34:00 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 76/224] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:34:00 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:34:01 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-70e202b7-5b96-47bb-8799-06e3a1ea3d1c req-467febe9-b7cc-44ce-9e62-cba7deaf132a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbf9e3f-365b-4749-8591-158ad177793f", "name": "network-vif-deleted", "tag": "0abc5ad0-4c5b-4585-bdb1-88832e4974fd"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:34:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-70e202b7-5b96-47bb-8799-06e3a1ea3d1c req-467febe9-b7cc-44ce-9e62-cba7deaf132a service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-70e202b7-5b96-47bb-8799-06e3a1ea3d1c req-467febe9-b7cc-44ce-9e62-cba7deaf132a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-70e202b7-5b96-47bb-8799-06e3a1ea3d1c req-467febe9-b7cc-44ce-9e62-cba7deaf132a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:01 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-70e202b7-5b96-47bb-8799-06e3a1ea3d1c req-467febe9-b7cc-44ce-9e62-cba7deaf132a service nova] Creating event network-vif-deleted:0abc5ad0-4c5b-4585-bdb1-88832e4974fd for instance 1fbf9e3f-365b-4749-8591-158ad177793f on user Apr 18 14:34:01 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-70e202b7-5b96-47bb-8799-06e3a1ea3d1c req-467febe9-b7cc-44ce-9e62-cba7deaf132a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030097 Apr 18 14:34:01 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 76/225] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:34:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:34:05 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-0be9b9a2-e812-4e76-923b-f6cc5502c4f3 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:05 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-0be9b9a2-e812-4e76-923b-f6cc5502c4f3 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] [instance: 6795fad9-3f0a-430b-8319-a3c6025122c3] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:05 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-0be9b9a2-e812-4e76-923b-f6cc5502c4f3 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:05 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-0be9b9a2-e812-4e76-923b-f6cc5502c4f3 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:05 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-0be9b9a2-e812-4e76-923b-f6cc5502c4f3 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:05 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-0be9b9a2-e812-4e76-923b-f6cc5502c4f3 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:05 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-0be9b9a2-e812-4e76-923b-f6cc5502c4f3 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:05 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-0be9b9a2-e812-4e76-923b-f6cc5502c4f3 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:06 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-0be9b9a2-e812-4e76-923b-f6cc5502c4f3 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53a60dd2a8ca42b391d4584accb60b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5667da319fd405e96f277368203a72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:34:06 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-0be9b9a2-e812-4e76-923b-f6cc5502c4f3 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3" status: 200 len: 1554 microversion: 2.1 time: 0.451053 Apr 18 14:34:06 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 74/226] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:05 2023] GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3 => generated 1554 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:34:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-03eac9f4-05f5-4c68-b7be-c96ac159253d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:08 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-03eac9f4-05f5-4c68-b7be-c96ac159253d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-03eac9f4-05f5-4c68-b7be-c96ac159253d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-03eac9f4-05f5-4c68-b7be-c96ac159253d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-03eac9f4-05f5-4c68-b7be-c96ac159253d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-03eac9f4-05f5-4c68-b7be-c96ac159253d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-03eac9f4-05f5-4c68-b7be-c96ac159253d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-03eac9f4-05f5-4c68-b7be-c96ac159253d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:08 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-03eac9f4-05f5-4c68-b7be-c96ac159253d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:34:08 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-03eac9f4-05f5-4c68-b7be-c96ac159253d tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1656 microversion: 2.1 time: 0.255883 Apr 18 14:34:08 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 77/227] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:08 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1656 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:34:08 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-bceb7575-ef1f-4850-b814-d9df6b3d0359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:08 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-bceb7575-ef1f-4850-b814-d9df6b3d0359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-bceb7575-ef1f-4850-b814-d9df6b3d0359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-bceb7575-ef1f-4850-b814-d9df6b3d0359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-bceb7575-ef1f-4850-b814-d9df6b3d0359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-bceb7575-ef1f-4850-b814-d9df6b3d0359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-bceb7575-ef1f-4850-b814-d9df6b3d0359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-bceb7575-ef1f-4850-b814-d9df6b3d0359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:08 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-bceb7575-ef1f-4850-b814-d9df6b3d0359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:34:08 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-bceb7575-ef1f-4850-b814-d9df6b3d0359 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1656 microversion: 2.1 time: 0.194123 Apr 18 14:34:08 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 77/228] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:08 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1656 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:34:08 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-c08e5a65-da0e-446e-bfe2-0b4a9dd6d891 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:08 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-c08e5a65-da0e-446e-bfe2-0b4a9dd6d891 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c08e5a65-da0e-446e-bfe2-0b4a9dd6d891 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c08e5a65-da0e-446e-bfe2-0b4a9dd6d891 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c08e5a65-da0e-446e-bfe2-0b4a9dd6d891 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c08e5a65-da0e-446e-bfe2-0b4a9dd6d891 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c08e5a65-da0e-446e-bfe2-0b4a9dd6d891 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c08e5a65-da0e-446e-bfe2-0b4a9dd6d891 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:09 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-c08e5a65-da0e-446e-bfe2-0b4a9dd6d891 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:34:09 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-c08e5a65-da0e-446e-bfe2-0b4a9dd6d891 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1656 microversion: 2.1 time: 0.840955 Apr 18 14:34:09 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 75/229] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:08 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1656 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:34:13 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-494c3c80-722f-4f6f-82dd-22b535f990aa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:13 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-494c3c80-722f-4f6f-82dd-22b535f990aa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: b6a78d1f-313b-4957-8a3f-75244b0b242f] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-494c3c80-722f-4f6f-82dd-22b535f990aa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-494c3c80-722f-4f6f-82dd-22b535f990aa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-494c3c80-722f-4f6f-82dd-22b535f990aa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-494c3c80-722f-4f6f-82dd-22b535f990aa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-494c3c80-722f-4f6f-82dd-22b535f990aa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:13 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-494c3c80-722f-4f6f-82dd-22b535f990aa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:14 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-494c3c80-722f-4f6f-82dd-22b535f990aa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae2d60ff00f4be59827e15aece5d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:34:14 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-494c3c80-722f-4f6f-82dd-22b535f990aa tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f" status: 200 len: 1534 microversion: 2.1 time: 0.253606 Apr 18 14:34:14 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 78/230] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:13 2023] GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f => generated 1534 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:34:20 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:34:20 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:34:20 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-53bbb8d9-5aed-4dc4-aaf2-c61469dece3b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:20 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-53bbb8d9-5aed-4dc4-aaf2-c61469dece3b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 38b44765-7b1f-449a-bd4d-99d1df340ba4] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-53bbb8d9-5aed-4dc4-aaf2-c61469dece3b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-53bbb8d9-5aed-4dc4-aaf2-c61469dece3b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-53bbb8d9-5aed-4dc4-aaf2-c61469dece3b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-53bbb8d9-5aed-4dc4-aaf2-c61469dece3b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-53bbb8d9-5aed-4dc4-aaf2-c61469dece3b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-53bbb8d9-5aed-4dc4-aaf2-c61469dece3b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:20 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-53bbb8d9-5aed-4dc4-aaf2-c61469dece3b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] HTTP exception thrown: Instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 could not be found. Apr 18 14:34:20 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-53bbb8d9-5aed-4dc4-aaf2-c61469dece3b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Request method failure captured: Apr 18 14:34:20 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/38b44765-7b1f-449a-bd4d-99d1df340ba4 HTTP/1.1 Apr 18 14:34:20 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:34:20 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:34:20 user devstack@n-api.service[61309]: Connection: close Apr 18 14:34:20 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:34:20 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:34:20 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:34:20 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:34:20 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqk7noBQQ4haiwXD2yJAOZ5pKKp8waPi3Vrg7O3MTPhuQ7m9tHFpFVlcNBMvIOlhhbKpBfAqURs2XbvRAMpA9q0LnQMS1_XOV6lrsrAlKh3v-4E7Zv4sKfHH5fJotByvCh3I6okkGYOlRkJ9dOTIwnl5XEybkX-S7kBoDYxnYXXuNBA Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Project-Id: 2d1e17fb95d64cae9c6c210d143d115b Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Project-Name: tempest-VolumesAdminNegativeTest-2075024961 Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d1e17fb95d64cae9c6c210d143d115b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d1e17fb95d64cae9c6c210d143d115b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d1e17fb95d64cae9c6c210d143d115b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Tenant: tempest-VolumesAdminNegativeTest-2075024961 Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Tenant-Id: 2d1e17fb95d64cae9c6c210d143d115b Apr 18 14:34:20 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2075024961 Apr 18 14:34:20 user devstack@n-api.service[61309]: X-User: tempest-VolumesAdminNegativeTest-2075024961-project-member Apr 18 14:34:20 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:34:20 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:34:20 user devstack@n-api.service[61309]: X-User-Id: 2039b3016f884a42abcb58054d649cee Apr 18 14:34:20 user devstack@n-api.service[61309]: X-User-Name: tempest-VolumesAdminNegativeTest-2075024961-project-member Apr 18 14:34:20 user devstack@n-api.service[61309]: method: > Apr 18 14:34:20 user devstack@n-api.service[61309]: exception: Instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 could not be found. Apr 18 14:34:20 user devstack@n-api.service[61309]: action_args: {'id': '38b44765-7b1f-449a-bd4d-99d1df340ba4'} Apr 18 14:34:20 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 could not be found. Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 could not be found. Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 could not be found. Apr 18 14:34:20 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:20 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-53bbb8d9-5aed-4dc4-aaf2-c61469dece3b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Returning 404 to user: Instance 38b44765-7b1f-449a-bd4d-99d1df340ba4 could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:34:20 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-53bbb8d9-5aed-4dc4-aaf2-c61469dece3b tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/38b44765-7b1f-449a-bd4d-99d1df340ba4" status: 404 len: 111 microversion: 2.1 time: 0.039678 Apr 18 14:34:20 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 78/231] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:20 2023] GET /compute/v2.1/servers/38b44765-7b1f-449a-bd4d-99d1df340ba4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:34:21 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-4ce106c4-dc19-4e71-b51c-e1683bd771ba tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:21 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-4ce106c4-dc19-4e71-b51c-e1683bd771ba tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 6d6793c2-2b28-4337-baf2-9fd9b4e70a36] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:21 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:34:21 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:34:21 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4ce106c4-dc19-4e71-b51c-e1683bd771ba tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:21 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4ce106c4-dc19-4e71-b51c-e1683bd771ba tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:21 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4ce106c4-dc19-4e71-b51c-e1683bd771ba tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:21 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4ce106c4-dc19-4e71-b51c-e1683bd771ba tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:21 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4ce106c4-dc19-4e71-b51c-e1683bd771ba tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:21 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4ce106c4-dc19-4e71-b51c-e1683bd771ba tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:21 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-4ce106c4-dc19-4e71-b51c-e1683bd771ba tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 6d6793c2-2b28-4337-baf2-9fd9b4e70a36] Going to try to terminate instance {{(pid=61311) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:34:21 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-4ce106c4-dc19-4e71-b51c-e1683bd771ba tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36" status: 204 len: 0 microversion: 2.1 time: 0.123681 Apr 18 14:34:21 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 76/232] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:34:21 2023] DELETE /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:34:21 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-580d1ec1-3ff6-4c31-9b50-33797be1c713 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:21 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-580d1ec1-3ff6-4c31-9b50-33797be1c713 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 6d6793c2-2b28-4337-baf2-9fd9b4e70a36] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:21 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-580d1ec1-3ff6-4c31-9b50-33797be1c713 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:21 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-580d1ec1-3ff6-4c31-9b50-33797be1c713 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:21 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-580d1ec1-3ff6-4c31-9b50-33797be1c713 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:21 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-580d1ec1-3ff6-4c31-9b50-33797be1c713 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:21 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-580d1ec1-3ff6-4c31-9b50-33797be1c713 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:21 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-580d1ec1-3ff6-4c31-9b50-33797be1c713 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:21 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-580d1ec1-3ff6-4c31-9b50-33797be1c713 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2039b3016f884a42abcb58054d649cee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1e17fb95d64cae9c6c210d143d115b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:34:21 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-580d1ec1-3ff6-4c31-9b50-33797be1c713 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36" status: 200 len: 1667 microversion: 2.1 time: 0.242154 Apr 18 14:34:21 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 79/233] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:21 2023] GET /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36 => generated 1667 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:34:21 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-0aac57fd-2be5-44d1-8419-73497f2e9696 req-32f9f326-6f04-43e7-8fd2-8aaaa302d83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6793c2-2b28-4337-baf2-9fd9b4e70a36", "name": "network-vif-unplugged", "status": "completed", "tag": "5d2983d3-2e25-4dfd-9dd0-28dbe2111d62"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:34:21 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0aac57fd-2be5-44d1-8419-73497f2e9696 req-32f9f326-6f04-43e7-8fd2-8aaaa302d83c service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:21 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0aac57fd-2be5-44d1-8419-73497f2e9696 req-32f9f326-6f04-43e7-8fd2-8aaaa302d83c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:21 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-0aac57fd-2be5-44d1-8419-73497f2e9696 req-32f9f326-6f04-43e7-8fd2-8aaaa302d83c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:21 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-0aac57fd-2be5-44d1-8419-73497f2e9696 req-32f9f326-6f04-43e7-8fd2-8aaaa302d83c service nova] Creating event network-vif-unplugged:5d2983d3-2e25-4dfd-9dd0-28dbe2111d62 for instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 on user Apr 18 14:34:21 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-0aac57fd-2be5-44d1-8419-73497f2e9696 req-32f9f326-6f04-43e7-8fd2-8aaaa302d83c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091690 Apr 18 14:34:21 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 79/234] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:34:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:34:22 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-aa33b199-cff0-4d6b-abbf-65ca14567510 req-1d78d6d6-c777-4a1c-9bfe-513507e3538c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6793c2-2b28-4337-baf2-9fd9b4e70a36", "name": "network-vif-deleted", "tag": "5d2983d3-2e25-4dfd-9dd0-28dbe2111d62"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:34:22 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-aa33b199-cff0-4d6b-abbf-65ca14567510 req-1d78d6d6-c777-4a1c-9bfe-513507e3538c service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:22 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-aa33b199-cff0-4d6b-abbf-65ca14567510 req-1d78d6d6-c777-4a1c-9bfe-513507e3538c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:22 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-aa33b199-cff0-4d6b-abbf-65ca14567510 req-1d78d6d6-c777-4a1c-9bfe-513507e3538c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:22 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-aa33b199-cff0-4d6b-abbf-65ca14567510 req-1d78d6d6-c777-4a1c-9bfe-513507e3538c service nova] Creating event network-vif-deleted:5d2983d3-2e25-4dfd-9dd0-28dbe2111d62 for instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 on user Apr 18 14:34:22 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-aa33b199-cff0-4d6b-abbf-65ca14567510 req-1d78d6d6-c777-4a1c-9bfe-513507e3538c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086864 Apr 18 14:34:22 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 77/235] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:34:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:34:23 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-492fd2f8-8927-4209-9005-3885e04b6170 req-c772f54b-048d-4ffe-931d-e293fc054143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6793c2-2b28-4337-baf2-9fd9b4e70a36", "name": "network-vif-plugged", "status": "completed", "tag": "5d2983d3-2e25-4dfd-9dd0-28dbe2111d62"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:34:23 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-492fd2f8-8927-4209-9005-3885e04b6170 req-c772f54b-048d-4ffe-931d-e293fc054143 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:23 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-492fd2f8-8927-4209-9005-3885e04b6170 req-c772f54b-048d-4ffe-931d-e293fc054143 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:23 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-492fd2f8-8927-4209-9005-3885e04b6170 req-c772f54b-048d-4ffe-931d-e293fc054143 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:23 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-492fd2f8-8927-4209-9005-3885e04b6170 req-c772f54b-048d-4ffe-931d-e293fc054143 service nova] Creating event network-vif-plugged:5d2983d3-2e25-4dfd-9dd0-28dbe2111d62 for instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 on user Apr 18 14:34:23 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-492fd2f8-8927-4209-9005-3885e04b6170 req-c772f54b-048d-4ffe-931d-e293fc054143 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Apr 18 14:34:23 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 80/236] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:34:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:34:46 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=4 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:34:46 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=4 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:34:46 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-0ecb3780-341f-40bc-b964-8a6d38027e9e tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:46 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-0ecb3780-341f-40bc-b964-8a6d38027e9e tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 909db006-c38d-4b50-acaa-4224aed6ea45] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:46 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-0ecb3780-341f-40bc-b964-8a6d38027e9e tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:46 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-0ecb3780-341f-40bc-b964-8a6d38027e9e tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:46 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-0ecb3780-341f-40bc-b964-8a6d38027e9e tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:46 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-0ecb3780-341f-40bc-b964-8a6d38027e9e tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:46 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-0ecb3780-341f-40bc-b964-8a6d38027e9e tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:46 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-0ecb3780-341f-40bc-b964-8a6d38027e9e tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:46 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-0ecb3780-341f-40bc-b964-8a6d38027e9e tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] HTTP exception thrown: Instance 909db006-c38d-4b50-acaa-4224aed6ea45 could not be found. Apr 18 14:34:46 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-0ecb3780-341f-40bc-b964-8a6d38027e9e tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Request method failure captured: Apr 18 14:34:46 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45 HTTP/1.1 Apr 18 14:34:46 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:34:46 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:34:46 user devstack@n-api.service[61309]: Connection: close Apr 18 14:34:46 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:34:46 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:34:46 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:34:46 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:34:46 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqkwZc8sXDQaY50C0khcH2-lJy4JcRieYQA09aNuMqZMylGT-jKIghEgotO9ozxnyMbfTUwNHBDxR1-5E0_sPHrDv7HSbPocG-Gjph3IMWKeSGiW-lZY-mT00xXRvI5FTBDHOIu0e0MD83hbqZe6UeKVHxFfhRR3tap7BotGUo-VDFk Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Project-Id: e4ca11d8beec4410a8a4c8ae7c8e4bed Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1890610007 Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4ca11d8beec4410a8a4c8ae7c8e4bed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4ca11d8beec4410a8a4c8ae7c8e4bed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4ca11d8beec4410a8a4c8ae7c8e4bed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1890610007 Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Tenant-Id: e4ca11d8beec4410a8a4c8ae7c8e4bed Apr 18 14:34:46 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1890610007 Apr 18 14:34:46 user devstack@n-api.service[61309]: X-User: tempest-ServerRescueNegativeTestJSON-1890610007-project-member Apr 18 14:34:46 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:34:46 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:34:46 user devstack@n-api.service[61309]: X-User-Id: 7e284b794c4043768af56fd58fceb837 Apr 18 14:34:46 user devstack@n-api.service[61309]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1890610007-project-member Apr 18 14:34:46 user devstack@n-api.service[61309]: method: > Apr 18 14:34:46 user devstack@n-api.service[61309]: exception: Instance 909db006-c38d-4b50-acaa-4224aed6ea45 could not be found. Apr 18 14:34:46 user devstack@n-api.service[61309]: action_args: {'id': '909db006-c38d-4b50-acaa-4224aed6ea45'} Apr 18 14:34:46 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909db006-c38d-4b50-acaa-4224aed6ea45 could not be found. Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909db006-c38d-4b50-acaa-4224aed6ea45 could not be found. Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909db006-c38d-4b50-acaa-4224aed6ea45 could not be found. Apr 18 14:34:46 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:46 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-0ecb3780-341f-40bc-b964-8a6d38027e9e tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Returning 404 to user: Instance 909db006-c38d-4b50-acaa-4224aed6ea45 could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:34:46 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-0ecb3780-341f-40bc-b964-8a6d38027e9e tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45" status: 404 len: 111 microversion: 2.1 time: 0.123667 Apr 18 14:34:46 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 80/237] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:46 2023] GET /compute/v2.1/servers/909db006-c38d-4b50-acaa-4224aed6ea45 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:34:46 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:34:46 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:34:46 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-6400cd75-b790-4d38-b99c-376f2439b82b tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:46 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-6400cd75-b790-4d38-b99c-376f2439b82b tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 1b067df0-2ea8-44e6-9418-98788edf4e7d] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:46 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6400cd75-b790-4d38-b99c-376f2439b82b tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:46 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6400cd75-b790-4d38-b99c-376f2439b82b tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:46 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6400cd75-b790-4d38-b99c-376f2439b82b tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:46 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6400cd75-b790-4d38-b99c-376f2439b82b tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:46 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6400cd75-b790-4d38-b99c-376f2439b82b tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:46 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6400cd75-b790-4d38-b99c-376f2439b82b tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:46 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-6400cd75-b790-4d38-b99c-376f2439b82b tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 1b067df0-2ea8-44e6-9418-98788edf4e7d] Going to try to terminate instance {{(pid=61311) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:34:46 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-6400cd75-b790-4d38-b99c-376f2439b82b tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1b067df0-2ea8-44e6-9418-98788edf4e7d" status: 204 len: 0 microversion: 2.1 time: 0.109645 Apr 18 14:34:46 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 78/238] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:34:46 2023] DELETE /compute/v2.1/servers/1b067df0-2ea8-44e6-9418-98788edf4e7d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:34:46 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=16 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:34:46 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=32 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:34:46 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-46f47307-cc97-4a48-a9eb-82180f6a9801 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:46 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-46f47307-cc97-4a48-a9eb-82180f6a9801 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 1b067df0-2ea8-44e6-9418-98788edf4e7d] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-46f47307-cc97-4a48-a9eb-82180f6a9801 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-46f47307-cc97-4a48-a9eb-82180f6a9801 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-46f47307-cc97-4a48-a9eb-82180f6a9801 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-46f47307-cc97-4a48-a9eb-82180f6a9801 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-46f47307-cc97-4a48-a9eb-82180f6a9801 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-46f47307-cc97-4a48-a9eb-82180f6a9801 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:47 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-46f47307-cc97-4a48-a9eb-82180f6a9801 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e284b794c4043768af56fd58fceb837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ca11d8beec4410a8a4c8ae7c8e4bed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:34:47 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-e7dc9f16-d429-4dff-9c64-23ac1f206159 req-4165e21f-4a6e-4fb1-999d-b4c78dc84f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b067df0-2ea8-44e6-9418-98788edf4e7d", "name": "network-vif-unplugged", "status": "completed", "tag": "1887cbf2-46d7-4b36-b8a4-83012bf1cb9f"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:34:47 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-46f47307-cc97-4a48-a9eb-82180f6a9801 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b067df0-2ea8-44e6-9418-98788edf4e7d" status: 200 len: 1510 microversion: 2.1 time: 0.287282 Apr 18 14:34:47 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 81/239] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:46 2023] GET /compute/v2.1/servers/1b067df0-2ea8-44e6-9418-98788edf4e7d => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:34:47 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-e7dc9f16-d429-4dff-9c64-23ac1f206159 req-4165e21f-4a6e-4fb1-999d-b4c78dc84f54 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:47 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-e7dc9f16-d429-4dff-9c64-23ac1f206159 req-4165e21f-4a6e-4fb1-999d-b4c78dc84f54 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:47 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-e7dc9f16-d429-4dff-9c64-23ac1f206159 req-4165e21f-4a6e-4fb1-999d-b4c78dc84f54 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:47 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-e7dc9f16-d429-4dff-9c64-23ac1f206159 req-4165e21f-4a6e-4fb1-999d-b4c78dc84f54 service nova] Creating event network-vif-unplugged:1887cbf2-46d7-4b36-b8a4-83012bf1cb9f for instance 1b067df0-2ea8-44e6-9418-98788edf4e7d on user Apr 18 14:34:47 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-e7dc9f16-d429-4dff-9c64-23ac1f206159 req-4165e21f-4a6e-4fb1-999d-b4c78dc84f54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077749 Apr 18 14:34:47 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 81/240] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:34:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:34:47 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-0e6c50e0-dae0-47ee-ae0b-cf6cda265dca tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:47 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-0e6c50e0-dae0-47ee-ae0b-cf6cda265dca tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: e5323297-c840-4fd6-9a76-727ed36de870] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:47 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-0e6c50e0-dae0-47ee-ae0b-cf6cda265dca tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:47 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-0e6c50e0-dae0-47ee-ae0b-cf6cda265dca tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:47 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-0e6c50e0-dae0-47ee-ae0b-cf6cda265dca tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:47 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-0e6c50e0-dae0-47ee-ae0b-cf6cda265dca tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:47 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-0e6c50e0-dae0-47ee-ae0b-cf6cda265dca tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:47 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-0e6c50e0-dae0-47ee-ae0b-cf6cda265dca tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:47 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-0e6c50e0-dae0-47ee-ae0b-cf6cda265dca tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b209357fca7f40c0b52507a285e054e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312c2b6e41142799cb66dd1377558d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:34:47 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-0e6c50e0-dae0-47ee-ae0b-cf6cda265dca tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870" status: 200 len: 1493 microversion: 2.1 time: 0.306715 Apr 18 14:34:47 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 79/241] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:47 2023] GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870 => generated 1493 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:34:48 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-17c9ec5e-e750-4c25-8222-1c0084ea8cda req-13b913f1-870f-41b4-929c-141442d048ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b067df0-2ea8-44e6-9418-98788edf4e7d", "name": "network-vif-deleted", "tag": "1887cbf2-46d7-4b36-b8a4-83012bf1cb9f"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:34:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-17c9ec5e-e750-4c25-8222-1c0084ea8cda req-13b913f1-870f-41b4-929c-141442d048ba service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-17c9ec5e-e750-4c25-8222-1c0084ea8cda req-13b913f1-870f-41b4-929c-141442d048ba service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-17c9ec5e-e750-4c25-8222-1c0084ea8cda req-13b913f1-870f-41b4-929c-141442d048ba service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-17c9ec5e-e750-4c25-8222-1c0084ea8cda req-13b913f1-870f-41b4-929c-141442d048ba service nova] Creating event network-vif-deleted:1887cbf2-46d7-4b36-b8a4-83012bf1cb9f for instance 1b067df0-2ea8-44e6-9418-98788edf4e7d on user Apr 18 14:34:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-17c9ec5e-e750-4c25-8222-1c0084ea8cda req-13b913f1-870f-41b4-929c-141442d048ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030823 Apr 18 14:34:48 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 82/242] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:34:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:34:49 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-8aea0829-708a-461c-987d-c342838f1be9 req-a7687af0-e3a1-4335-9b9d-ad56d9516905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b067df0-2ea8-44e6-9418-98788edf4e7d", "name": "network-vif-plugged", "status": "completed", "tag": "1887cbf2-46d7-4b36-b8a4-83012bf1cb9f"}, {"server_uuid": "1b067df0-2ea8-44e6-9418-98788edf4e7d", "name": "network-vif-plugged", "status": "completed", "tag": "1887cbf2-46d7-4b36-b8a4-83012bf1cb9f"}, {"server_uuid": "1b067df0-2ea8-44e6-9418-98788edf4e7d", "name": "network-vif-plugged", "status": "completed", "tag": "1887cbf2-46d7-4b36-b8a4-83012bf1cb9f"}, {"server_uuid": "1b067df0-2ea8-44e6-9418-98788edf4e7d", "name": "network-vif-plugged", "status": "completed", "tag": "1887cbf2-46d7-4b36-b8a4-83012bf1cb9f"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:34:49 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8aea0829-708a-461c-987d-c342838f1be9 req-a7687af0-e3a1-4335-9b9d-ad56d9516905 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:49 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8aea0829-708a-461c-987d-c342838f1be9 req-a7687af0-e3a1-4335-9b9d-ad56d9516905 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:49 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8aea0829-708a-461c-987d-c342838f1be9 req-a7687af0-e3a1-4335-9b9d-ad56d9516905 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:49 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-8aea0829-708a-461c-987d-c342838f1be9 req-a7687af0-e3a1-4335-9b9d-ad56d9516905 service nova] Creating event network-vif-plugged:1887cbf2-46d7-4b36-b8a4-83012bf1cb9f for instance 1b067df0-2ea8-44e6-9418-98788edf4e7d on user Apr 18 14:34:49 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-8aea0829-708a-461c-987d-c342838f1be9 req-a7687af0-e3a1-4335-9b9d-ad56d9516905 service nova] Creating event network-vif-plugged:1887cbf2-46d7-4b36-b8a4-83012bf1cb9f for instance 1b067df0-2ea8-44e6-9418-98788edf4e7d on user Apr 18 14:34:49 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-8aea0829-708a-461c-987d-c342838f1be9 req-a7687af0-e3a1-4335-9b9d-ad56d9516905 service nova] Creating event network-vif-plugged:1887cbf2-46d7-4b36-b8a4-83012bf1cb9f for instance 1b067df0-2ea8-44e6-9418-98788edf4e7d on user Apr 18 14:34:49 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-8aea0829-708a-461c-987d-c342838f1be9 req-a7687af0-e3a1-4335-9b9d-ad56d9516905 service nova] Creating event network-vif-plugged:1887cbf2-46d7-4b36-b8a4-83012bf1cb9f for instance 1b067df0-2ea8-44e6-9418-98788edf4e7d on user Apr 18 14:34:49 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-8aea0829-708a-461c-987d-c342838f1be9 req-a7687af0-e3a1-4335-9b9d-ad56d9516905 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.030397 Apr 18 14:34:49 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 82/243] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:34:49 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:34:50 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-d82d5ca2-bf2f-4a7b-b2b9-ac62620a8d96 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:50 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-d82d5ca2-bf2f-4a7b-b2b9-ac62620a8d96 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 1fbf9e3f-365b-4749-8591-158ad177793f] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d82d5ca2-bf2f-4a7b-b2b9-ac62620a8d96 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d82d5ca2-bf2f-4a7b-b2b9-ac62620a8d96 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d82d5ca2-bf2f-4a7b-b2b9-ac62620a8d96 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d82d5ca2-bf2f-4a7b-b2b9-ac62620a8d96 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d82d5ca2-bf2f-4a7b-b2b9-ac62620a8d96 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d82d5ca2-bf2f-4a7b-b2b9-ac62620a8d96 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:50 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-d82d5ca2-bf2f-4a7b-b2b9-ac62620a8d96 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] HTTP exception thrown: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:50 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-d82d5ca2-bf2f-4a7b-b2b9-ac62620a8d96 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Request method failure captured: Apr 18 14:34:50 user devstack@n-api.service[61311]: request: GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f HTTP/1.1 Apr 18 14:34:50 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:34:50 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:34:50 user devstack@n-api.service[61311]: Connection: close Apr 18 14:34:50 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:34:50 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:34:50 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:34:50 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:34:50 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqk04uBwuqpXGvA4GAJytq0eMq0TbFZPqKdiT9GWHczMKlYJwXeVngWkOgi81EMnzelj2C6ObSST4iIXw45_QfB4NnyqH32wTn0yYnJSTtmNkzF_c5d3G_f_qqTa01BtjWV3rhZC_FNNyAe43SrsHjgP3irY_Dz-2Be3wLBPiA_qT2s Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Project-Id: 88dd648f400c48f384c828c3933baa5a Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Project-Name: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Tenant: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Tenant-Id: 88dd648f400c48f384c828c3933baa5a Apr 18 14:34:50 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:50 user devstack@n-api.service[61311]: X-User: tempest-AttachVolumeTestJSON-1067811846-project-member Apr 18 14:34:50 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:34:50 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:34:50 user devstack@n-api.service[61311]: X-User-Id: 36b9b392cafe4b58b429be8e010baa08 Apr 18 14:34:50 user devstack@n-api.service[61311]: X-User-Name: tempest-AttachVolumeTestJSON-1067811846-project-member Apr 18 14:34:50 user devstack@n-api.service[61311]: method: > Apr 18 14:34:50 user devstack@n-api.service[61311]: exception: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:50 user devstack@n-api.service[61311]: action_args: {'id': '1fbf9e3f-365b-4749-8591-158ad177793f'} Apr 18 14:34:50 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:50 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:34:50 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-d82d5ca2-bf2f-4a7b-b2b9-ac62620a8d96 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Returning 404 to user: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:34:50 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-d82d5ca2-bf2f-4a7b-b2b9-ac62620a8d96 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f" status: 404 len: 111 microversion: 2.1 time: 0.128879 Apr 18 14:34:50 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 80/244] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:50 2023] GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:34:50 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-65b6ab96-6e92-4c7b-a7fb-7792e21b41f2 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '.version_select at 0x7f5ceeafb1c0>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:50 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-65b6ab96-6e92-4c7b-a7fb-7792e21b41f2 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1743159305" status: 202 len: 0 microversion: 2.1 time: 0.023548 Apr 18 14:34:50 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 83/245] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 14:34:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1743159305 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-75933dd6-b59a-41b9-9c71-34f026b810b3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-75933dd6-b59a-41b9-9c71-34f026b810b3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 1fbf9e3f-365b-4749-8591-158ad177793f] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-75933dd6-b59a-41b9-9c71-34f026b810b3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-75933dd6-b59a-41b9-9c71-34f026b810b3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-75933dd6-b59a-41b9-9c71-34f026b810b3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-75933dd6-b59a-41b9-9c71-34f026b810b3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-75933dd6-b59a-41b9-9c71-34f026b810b3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-75933dd6-b59a-41b9-9c71-34f026b810b3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:51 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-75933dd6-b59a-41b9-9c71-34f026b810b3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] HTTP exception thrown: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-75933dd6-b59a-41b9-9c71-34f026b810b3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Request method failure captured: Apr 18 14:34:51 user devstack@n-api.service[61309]: request: DELETE /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f HTTP/1.1 Apr 18 14:34:51 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:34:51 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:34:51 user devstack@n-api.service[61309]: Connection: close Apr 18 14:34:51 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:34:51 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:34:51 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:34:51 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:34:51 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqk04uBwuqpXGvA4GAJytq0eMq0TbFZPqKdiT9GWHczMKlYJwXeVngWkOgi81EMnzelj2C6ObSST4iIXw45_QfB4NnyqH32wTn0yYnJSTtmNkzF_c5d3G_f_qqTa01BtjWV3rhZC_FNNyAe43SrsHjgP3irY_Dz-2Be3wLBPiA_qT2s Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Project-Id: 88dd648f400c48f384c828c3933baa5a Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Project-Name: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Tenant: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Tenant-Id: 88dd648f400c48f384c828c3933baa5a Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:51 user devstack@n-api.service[61309]: X-User: tempest-AttachVolumeTestJSON-1067811846-project-member Apr 18 14:34:51 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:34:51 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:34:51 user devstack@n-api.service[61309]: X-User-Id: 36b9b392cafe4b58b429be8e010baa08 Apr 18 14:34:51 user devstack@n-api.service[61309]: X-User-Name: tempest-AttachVolumeTestJSON-1067811846-project-member Apr 18 14:34:51 user devstack@n-api.service[61309]: method: > Apr 18 14:34:51 user devstack@n-api.service[61309]: exception: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:51 user devstack@n-api.service[61309]: action_args: {'id': '1fbf9e3f-365b-4749-8591-158ad177793f'} Apr 18 14:34:51 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-75933dd6-b59a-41b9-9c71-34f026b810b3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Returning 404 to user: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:34:51 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-75933dd6-b59a-41b9-9c71-34f026b810b3 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f" status: 404 len: 111 microversion: 2.1 time: 0.027969 Apr 18 14:34:51 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 83/246] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:34:51 2023] DELETE /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:34:51 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-c51cc355-7bcc-4fad-9b97-22820a60b731 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:51 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-c51cc355-7bcc-4fad-9b97-22820a60b731 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 1fbf9e3f-365b-4749-8591-158ad177793f] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c51cc355-7bcc-4fad-9b97-22820a60b731 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c51cc355-7bcc-4fad-9b97-22820a60b731 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c51cc355-7bcc-4fad-9b97-22820a60b731 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c51cc355-7bcc-4fad-9b97-22820a60b731 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c51cc355-7bcc-4fad-9b97-22820a60b731 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-c51cc355-7bcc-4fad-9b97-22820a60b731 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:51 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-c51cc355-7bcc-4fad-9b97-22820a60b731 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] HTTP exception thrown: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:51 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-c51cc355-7bcc-4fad-9b97-22820a60b731 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Request method failure captured: Apr 18 14:34:51 user devstack@n-api.service[61311]: request: GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f HTTP/1.1 Apr 18 14:34:51 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:34:51 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:34:51 user devstack@n-api.service[61311]: Connection: close Apr 18 14:34:51 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:34:51 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:34:51 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:34:51 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:34:51 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqk04uBwuqpXGvA4GAJytq0eMq0TbFZPqKdiT9GWHczMKlYJwXeVngWkOgi81EMnzelj2C6ObSST4iIXw45_QfB4NnyqH32wTn0yYnJSTtmNkzF_c5d3G_f_qqTa01BtjWV3rhZC_FNNyAe43SrsHjgP3irY_Dz-2Be3wLBPiA_qT2s Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Project-Id: 88dd648f400c48f384c828c3933baa5a Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Project-Name: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Tenant: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Tenant-Id: 88dd648f400c48f384c828c3933baa5a Apr 18 14:34:51 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:51 user devstack@n-api.service[61311]: X-User: tempest-AttachVolumeTestJSON-1067811846-project-member Apr 18 14:34:51 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:34:51 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:34:51 user devstack@n-api.service[61311]: X-User-Id: 36b9b392cafe4b58b429be8e010baa08 Apr 18 14:34:51 user devstack@n-api.service[61311]: X-User-Name: tempest-AttachVolumeTestJSON-1067811846-project-member Apr 18 14:34:51 user devstack@n-api.service[61311]: method: > Apr 18 14:34:51 user devstack@n-api.service[61311]: exception: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:51 user devstack@n-api.service[61311]: action_args: {'id': '1fbf9e3f-365b-4749-8591-158ad177793f'} Apr 18 14:34:51 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. Apr 18 14:34:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-c51cc355-7bcc-4fad-9b97-22820a60b731 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Returning 404 to user: Instance 1fbf9e3f-365b-4749-8591-158ad177793f could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:34:51 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-c51cc355-7bcc-4fad-9b97-22820a60b731 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f" status: 404 len: 111 microversion: 2.1 time: 0.033221 Apr 18 14:34:51 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 81/247] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:51 2023] GET /compute/v2.1/servers/1fbf9e3f-365b-4749-8591-158ad177793f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:34:51 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-9242acb2-1e55-45ac-bfec-c5756072d1c7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:51 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-9242acb2-1e55-45ac-bfec-c5756072d1c7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 6dcffb71-055a-4ae6-bf65-df885c035e5a] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:51 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9242acb2-1e55-45ac-bfec-c5756072d1c7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:51 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9242acb2-1e55-45ac-bfec-c5756072d1c7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:51 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9242acb2-1e55-45ac-bfec-c5756072d1c7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:51 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9242acb2-1e55-45ac-bfec-c5756072d1c7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:51 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9242acb2-1e55-45ac-bfec-c5756072d1c7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:51 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9242acb2-1e55-45ac-bfec-c5756072d1c7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:51 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-9242acb2-1e55-45ac-bfec-c5756072d1c7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] HTTP exception thrown: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:34:51 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-9242acb2-1e55-45ac-bfec-c5756072d1c7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Request method failure captured: Apr 18 14:34:51 user devstack@n-api.service[61310]: request: DELETE /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a HTTP/1.1 Apr 18 14:34:51 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:34:51 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:34:51 user devstack@n-api.service[61310]: Connection: close Apr 18 14:34:51 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:34:51 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:34:51 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:34:51 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:34:51 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqk04uBwuqpXGvA4GAJytq0eMq0TbFZPqKdiT9GWHczMKlYJwXeVngWkOgi81EMnzelj2C6ObSST4iIXw45_QfB4NnyqH32wTn0yYnJSTtmNkzF_c5d3G_f_qqTa01BtjWV3rhZC_FNNyAe43SrsHjgP3irY_Dz-2Be3wLBPiA_qT2s Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Project-Id: 88dd648f400c48f384c828c3933baa5a Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Project-Name: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Tenant: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Tenant-Id: 88dd648f400c48f384c828c3933baa5a Apr 18 14:34:51 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:51 user devstack@n-api.service[61310]: X-User: tempest-AttachVolumeTestJSON-1067811846-project-member Apr 18 14:34:51 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:34:51 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:34:51 user devstack@n-api.service[61310]: X-User-Id: 36b9b392cafe4b58b429be8e010baa08 Apr 18 14:34:51 user devstack@n-api.service[61310]: X-User-Name: tempest-AttachVolumeTestJSON-1067811846-project-member Apr 18 14:34:51 user devstack@n-api.service[61310]: method: > Apr 18 14:34:51 user devstack@n-api.service[61310]: exception: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:34:51 user devstack@n-api.service[61310]: action_args: {'id': '6dcffb71-055a-4ae6-bf65-df885c035e5a'} Apr 18 14:34:51 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:34:51 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-9242acb2-1e55-45ac-bfec-c5756072d1c7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Returning 404 to user: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:34:51 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-9242acb2-1e55-45ac-bfec-c5756072d1c7 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a" status: 404 len: 111 microversion: 2.1 time: 0.031142 Apr 18 14:34:51 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 84/248] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:34:51 2023] DELETE /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-d9ad337f-0515-496a-aea4-1bb4b1ed7528 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-d9ad337f-0515-496a-aea4-1bb4b1ed7528 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] [instance: 6dcffb71-055a-4ae6-bf65-df885c035e5a] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d9ad337f-0515-496a-aea4-1bb4b1ed7528 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d9ad337f-0515-496a-aea4-1bb4b1ed7528 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d9ad337f-0515-496a-aea4-1bb4b1ed7528 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d9ad337f-0515-496a-aea4-1bb4b1ed7528 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d9ad337f-0515-496a-aea4-1bb4b1ed7528 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d9ad337f-0515-496a-aea4-1bb4b1ed7528 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:34:51 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-d9ad337f-0515-496a-aea4-1bb4b1ed7528 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] HTTP exception thrown: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-d9ad337f-0515-496a-aea4-1bb4b1ed7528 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Request method failure captured: Apr 18 14:34:51 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a HTTP/1.1 Apr 18 14:34:51 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:34:51 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:34:51 user devstack@n-api.service[61309]: Connection: close Apr 18 14:34:51 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:34:51 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:34:51 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:34:51 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:34:51 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqk04uBwuqpXGvA4GAJytq0eMq0TbFZPqKdiT9GWHczMKlYJwXeVngWkOgi81EMnzelj2C6ObSST4iIXw45_QfB4NnyqH32wTn0yYnJSTtmNkzF_c5d3G_f_qqTa01BtjWV3rhZC_FNNyAe43SrsHjgP3irY_Dz-2Be3wLBPiA_qT2s Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Project-Id: 88dd648f400c48f384c828c3933baa5a Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Project-Name: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88dd648f400c48f384c828c3933baa5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Tenant: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Tenant-Id: 88dd648f400c48f384c828c3933baa5a Apr 18 14:34:51 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1067811846 Apr 18 14:34:51 user devstack@n-api.service[61309]: X-User: tempest-AttachVolumeTestJSON-1067811846-project-member Apr 18 14:34:51 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:34:51 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:34:51 user devstack@n-api.service[61309]: X-User-Id: 36b9b392cafe4b58b429be8e010baa08 Apr 18 14:34:51 user devstack@n-api.service[61309]: X-User-Name: tempest-AttachVolumeTestJSON-1067811846-project-member Apr 18 14:34:51 user devstack@n-api.service[61309]: method: > Apr 18 14:34:51 user devstack@n-api.service[61309]: exception: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:34:51 user devstack@n-api.service[61309]: action_args: {'id': '6dcffb71-055a-4ae6-bf65-df885c035e5a'} Apr 18 14:34:51 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. Apr 18 14:34:51 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:34:51 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-d9ad337f-0515-496a-aea4-1bb4b1ed7528 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] Returning 404 to user: Instance 6dcffb71-055a-4ae6-bf65-df885c035e5a could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:34:51 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-d9ad337f-0515-496a-aea4-1bb4b1ed7528 tempest-AttachVolumeTestJSON-1067811846 tempest-AttachVolumeTestJSON-1067811846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a" status: 404 len: 111 microversion: 2.1 time: 0.029281 Apr 18 14:34:51 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 84/249] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:34:51 2023] GET /compute/v2.1/servers/6dcffb71-055a-4ae6-bf65-df885c035e5a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:35:06 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-62f01449-448b-4a84-bf0e-56521214e91d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:06 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-62f01449-448b-4a84-bf0e-56521214e91d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] [instance: 6795fad9-3f0a-430b-8319-a3c6025122c3] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:06 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:06 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:06 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-62f01449-448b-4a84-bf0e-56521214e91d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:06 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-62f01449-448b-4a84-bf0e-56521214e91d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:06 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-62f01449-448b-4a84-bf0e-56521214e91d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:06 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-62f01449-448b-4a84-bf0e-56521214e91d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:06 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-62f01449-448b-4a84-bf0e-56521214e91d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:06 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-62f01449-448b-4a84-bf0e-56521214e91d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:06 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-62f01449-448b-4a84-bf0e-56521214e91d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.186438 Apr 18 14:35:06 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 82/250] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 14:35:06 2023] GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3/os-interface => generated 282 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:35:07 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-89e145ec-f037-4c2c-a167-9d3b4ffa725d req-b6e4cbfe-842b-4512-8e66-b26dfaec12ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6795fad9-3f0a-430b-8319-a3c6025122c3", "tag": "e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:07 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:07 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=10 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:07 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-89e145ec-f037-4c2c-a167-9d3b4ffa725d req-b6e4cbfe-842b-4512-8e66-b26dfaec12ab service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:07 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-89e145ec-f037-4c2c-a167-9d3b4ffa725d req-b6e4cbfe-842b-4512-8e66-b26dfaec12ab service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:07 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-89e145ec-f037-4c2c-a167-9d3b4ffa725d req-b6e4cbfe-842b-4512-8e66-b26dfaec12ab service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:07 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-89e145ec-f037-4c2c-a167-9d3b4ffa725d req-b6e4cbfe-842b-4512-8e66-b26dfaec12ab service nova] Creating event network-changed:e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d for instance 6795fad9-3f0a-430b-8319-a3c6025122c3 on user Apr 18 14:35:07 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-89e145ec-f037-4c2c-a167-9d3b4ffa725d req-b6e4cbfe-842b-4512-8e66-b26dfaec12ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034148 Apr 18 14:35:07 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 85/251] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:35:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:35:07 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-cf797325-5062-49f4-ad3c-6c3f425a4fe6 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-350164652"}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:07 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-cf797325-5062-49f4-ad3c-6c3f425a4fe6 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] [instance: 6795fad9-3f0a-430b-8319-a3c6025122c3] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:07 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=10 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:07 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=10 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cf797325-5062-49f4-ad3c-6c3f425a4fe6 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cf797325-5062-49f4-ad3c-6c3f425a4fe6 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cf797325-5062-49f4-ad3c-6c3f425a4fe6 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cf797325-5062-49f4-ad3c-6c3f425a4fe6 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cf797325-5062-49f4-ad3c-6c3f425a4fe6 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cf797325-5062-49f4-ad3c-6c3f425a4fe6 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:08 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-cf797325-5062-49f4-ad3c-6c3f425a4fe6 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3/action" status: 202 len: 0 microversion: 2.1 time: 0.798097 Apr 18 14:35:08 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 85/252] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 14:35:07 2023] POST /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3/action => generated 0 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 18 14:35:08 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-002bd865-f070-4f0b-9fd1-9d19377bc6cd tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '.version_select at 0x7f5cee94ff40>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:08 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-002bd865-f070-4f0b-9fd1-9d19377bc6cd tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "GET /compute/v2.1/images/a0410ede-d99d-41ed-b0a2-292d19cd7f10" status: 200 len: 1606 microversion: 2.1 time: 0.051936 Apr 18 14:35:08 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 83/253] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 14:35:08 2023] GET /compute/v2.1/images/a0410ede-d99d-41ed-b0a2-292d19cd7f10 => generated 1606 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:35:11 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-cbfc2e4b-23ed-4bac-a176-1fd669e779b9 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:11 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-cbfc2e4b-23ed-4bac-a176-1fd669e779b9 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-cbfc2e4b-23ed-4bac-a176-1fd669e779b9 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-cbfc2e4b-23ed-4bac-a176-1fd669e779b9 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-cbfc2e4b-23ed-4bac-a176-1fd669e779b9 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-cbfc2e4b-23ed-4bac-a176-1fd669e779b9 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-cbfc2e4b-23ed-4bac-a176-1fd669e779b9 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-cbfc2e4b-23ed-4bac-a176-1fd669e779b9 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:11 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-c38b2d61-fd4c-41eb-bcc0-cca5c1e2c66f tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:11 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-c38b2d61-fd4c-41eb-bcc0-cca5c1e2c66f tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] [instance: 6d6793c2-2b28-4337-baf2-9fd9b4e70a36] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:11 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-c38b2d61-fd4c-41eb-bcc0-cca5c1e2c66f tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:11 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-c38b2d61-fd4c-41eb-bcc0-cca5c1e2c66f tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:11 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-c38b2d61-fd4c-41eb-bcc0-cca5c1e2c66f tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:11 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-c38b2d61-fd4c-41eb-bcc0-cca5c1e2c66f tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:11 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-c38b2d61-fd4c-41eb-bcc0-cca5c1e2c66f tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:11 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-c38b2d61-fd4c-41eb-bcc0-cca5c1e2c66f tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:11 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-c38b2d61-fd4c-41eb-bcc0-cca5c1e2c66f tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] HTTP exception thrown: Instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 could not be found. Apr 18 14:35:11 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-c38b2d61-fd4c-41eb-bcc0-cca5c1e2c66f tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Request method failure captured: Apr 18 14:35:11 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36 HTTP/1.1 Apr 18 14:35:11 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:35:11 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:35:11 user devstack@n-api.service[61309]: Connection: close Apr 18 14:35:11 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:35:11 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:35:11 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:35:11 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:35:11 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqk7noBQQ4haiwXD2yJAOZ5pKKp8waPi3Vrg7O3MTPhuQ7m9tHFpFVlcNBMvIOlhhbKpBfAqURs2XbvRAMpA9q0LnQMS1_XOV6lrsrAlKh3v-4E7Zv4sKfHH5fJotByvCh3I6okkGYOlRkJ9dOTIwnl5XEybkX-S7kBoDYxnYXXuNBA Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Project-Id: 2d1e17fb95d64cae9c6c210d143d115b Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Project-Name: tempest-VolumesAdminNegativeTest-2075024961 Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d1e17fb95d64cae9c6c210d143d115b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d1e17fb95d64cae9c6c210d143d115b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d1e17fb95d64cae9c6c210d143d115b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Tenant: tempest-VolumesAdminNegativeTest-2075024961 Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Tenant-Id: 2d1e17fb95d64cae9c6c210d143d115b Apr 18 14:35:11 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2075024961 Apr 18 14:35:11 user devstack@n-api.service[61309]: X-User: tempest-VolumesAdminNegativeTest-2075024961-project-member Apr 18 14:35:11 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:35:11 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:35:11 user devstack@n-api.service[61309]: X-User-Id: 2039b3016f884a42abcb58054d649cee Apr 18 14:35:11 user devstack@n-api.service[61309]: X-User-Name: tempest-VolumesAdminNegativeTest-2075024961-project-member Apr 18 14:35:11 user devstack@n-api.service[61309]: method: > Apr 18 14:35:11 user devstack@n-api.service[61309]: exception: Instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 could not be found. Apr 18 14:35:11 user devstack@n-api.service[61309]: action_args: {'id': '6d6793c2-2b28-4337-baf2-9fd9b4e70a36'} Apr 18 14:35:11 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 could not be found. Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 could not be found. Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 could not be found. Apr 18 14:35:11 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:35:11 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-c38b2d61-fd4c-41eb-bcc0-cca5c1e2c66f tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Returning 404 to user: Instance 6d6793c2-2b28-4337-baf2-9fd9b4e70a36 could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:35:11 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-c38b2d61-fd4c-41eb-bcc0-cca5c1e2c66f tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36" status: 404 len: 111 microversion: 2.1 time: 0.204864 Apr 18 14:35:11 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 86/254] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:35:11 2023] GET /compute/v2.1/servers/6d6793c2-2b28-4337-baf2-9fd9b4e70a36 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:35:11 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-78d4f82e-7dfc-4202-a09e-66b322e727f2 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] Calling method '.version_select at 0x7f5cee94c550>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:11 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-78d4f82e-7dfc-4202-a09e-66b322e727f2 tempest-VolumesAdminNegativeTest-2075024961 tempest-VolumesAdminNegativeTest-2075024961-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-443542451" status: 202 len: 0 microversion: 2.1 time: 0.022511 Apr 18 14:35:11 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 84/255] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 14:35:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-443542451 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:35:11 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-cbfc2e4b-23ed-4bac-a176-1fd669e779b9 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:35:11 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-cbfc2e4b-23ed-4bac-a176-1fd669e779b9 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1656 microversion: 2.1 time: 0.345004 Apr 18 14:35:11 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 86/256] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:35:11 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1656 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:35:14 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-4d9fc679-90b0-47bf-b197-33f1ab32fe89 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:14 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-4d9fc679-90b0-47bf-b197-33f1ab32fe89 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: b6a78d1f-313b-4957-8a3f-75244b0b242f] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:14 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4d9fc679-90b0-47bf-b197-33f1ab32fe89 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:14 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4d9fc679-90b0-47bf-b197-33f1ab32fe89 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:14 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4d9fc679-90b0-47bf-b197-33f1ab32fe89 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:14 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4d9fc679-90b0-47bf-b197-33f1ab32fe89 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:14 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4d9fc679-90b0-47bf-b197-33f1ab32fe89 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:14 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4d9fc679-90b0-47bf-b197-33f1ab32fe89 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:14 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-4d9fc679-90b0-47bf-b197-33f1ab32fe89 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae2d60ff00f4be59827e15aece5d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:35:14 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-4d9fc679-90b0-47bf-b197-33f1ab32fe89 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f" status: 200 len: 1534 microversion: 2.1 time: 0.257005 Apr 18 14:35:14 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 87/257] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:35:14 2023] GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f => generated 1534 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:35:14 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-9c0d47a7-0b2e-4b8c-b329-b84fd8d31a11 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:14 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-9c0d47a7-0b2e-4b8c-b329-b84fd8d31a11 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ae2d60ff00f4be59827e15aece5d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:35:14 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-9c0d47a7-0b2e-4b8c-b329-b84fd8d31a11 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Searching by: {'deleted': False, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8'} {{(pid=61311) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 14:35:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-9c0d47a7-0b2e-4b8c-b329-b84fd8d31a11 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-9c0d47a7-0b2e-4b8c-b329-b84fd8d31a11 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-9c0d47a7-0b2e-4b8c-b329-b84fd8d31a11 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-9c0d47a7-0b2e-4b8c-b329-b84fd8d31a11 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-9c0d47a7-0b2e-4b8c-b329-b84fd8d31a11 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-9c0d47a7-0b2e-4b8c-b329-b84fd8d31a11 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:14 user devstack@n-api.service[61311]: DEBUG nova.compute.multi_cell_list [None req-9c0d47a7-0b2e-4b8c-b329-b84fd8d31a11 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61311) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 14:35:14 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-9c0d47a7-0b2e-4b8c-b329-b84fd8d31a11 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.079538 Apr 18 14:35:14 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 85/258] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 14:35:14 2023] GET /compute/v2.1/servers => generated 341 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:35:14 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-2cfaec0b-8b4b-471f-94f6-7ca73e1e09ea tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:14 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-2cfaec0b-8b4b-471f-94f6-7ca73e1e09ea tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: b6a78d1f-313b-4957-8a3f-75244b0b242f] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-2cfaec0b-8b4b-471f-94f6-7ca73e1e09ea tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-2cfaec0b-8b4b-471f-94f6-7ca73e1e09ea tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-2cfaec0b-8b4b-471f-94f6-7ca73e1e09ea tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-2cfaec0b-8b4b-471f-94f6-7ca73e1e09ea tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-2cfaec0b-8b4b-471f-94f6-7ca73e1e09ea tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-2cfaec0b-8b4b-471f-94f6-7ca73e1e09ea tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:14 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-2cfaec0b-8b4b-471f-94f6-7ca73e1e09ea tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae2d60ff00f4be59827e15aece5d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:35:14 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-2cfaec0b-8b4b-471f-94f6-7ca73e1e09ea tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f" status: 200 len: 1534 microversion: 2.1 time: 0.155258 Apr 18 14:35:14 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 87/259] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:35:14 2023] GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f => generated 1534 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:35:16 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-d819d637-8bb9-4066-bb66-081ba6055b8d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:16 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-d819d637-8bb9-4066-bb66-081ba6055b8d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: b6a78d1f-313b-4957-8a3f-75244b0b242f] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d819d637-8bb9-4066-bb66-081ba6055b8d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d819d637-8bb9-4066-bb66-081ba6055b8d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d819d637-8bb9-4066-bb66-081ba6055b8d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d819d637-8bb9-4066-bb66-081ba6055b8d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d819d637-8bb9-4066-bb66-081ba6055b8d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d819d637-8bb9-4066-bb66-081ba6055b8d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:16 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-d819d637-8bb9-4066-bb66-081ba6055b8d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: b6a78d1f-313b-4957-8a3f-75244b0b242f] Going to try to terminate instance {{(pid=61309) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:35:16 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-d819d637-8bb9-4066-bb66-081ba6055b8d tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f" status: 204 len: 0 microversion: 2.1 time: 0.111127 Apr 18 14:35:16 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 88/260] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:35:16 2023] DELETE /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:35:16 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-f1d05ceb-2c3a-4541-bce6-19c3979a60f0 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:16 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-f1d05ceb-2c3a-4541-bce6-19c3979a60f0 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: b6a78d1f-313b-4957-8a3f-75244b0b242f] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:16 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-f1d05ceb-2c3a-4541-bce6-19c3979a60f0 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:16 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-f1d05ceb-2c3a-4541-bce6-19c3979a60f0 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:16 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-f1d05ceb-2c3a-4541-bce6-19c3979a60f0 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:16 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-f1d05ceb-2c3a-4541-bce6-19c3979a60f0 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:16 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-f1d05ceb-2c3a-4541-bce6-19c3979a60f0 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:16 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-f1d05ceb-2c3a-4541-bce6-19c3979a60f0 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:16 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-b6b484b1-764d-4dc1-964e-b03fd1bdc8f4 req-fb002355-0103-46d6-b646-835f9265558d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a78d1f-313b-4957-8a3f-75244b0b242f", "name": "network-vif-unplugged", "status": "completed", "tag": "05bb8b6c-a9cd-4476-86f7-66825eefc586"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-b6b484b1-764d-4dc1-964e-b03fd1bdc8f4 req-fb002355-0103-46d6-b646-835f9265558d service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-b6b484b1-764d-4dc1-964e-b03fd1bdc8f4 req-fb002355-0103-46d6-b646-835f9265558d service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-b6b484b1-764d-4dc1-964e-b03fd1bdc8f4 req-fb002355-0103-46d6-b646-835f9265558d service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:16 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-b6b484b1-764d-4dc1-964e-b03fd1bdc8f4 req-fb002355-0103-46d6-b646-835f9265558d service nova] Creating event network-vif-unplugged:05bb8b6c-a9cd-4476-86f7-66825eefc586 for instance b6a78d1f-313b-4957-8a3f-75244b0b242f on user Apr 18 14:35:16 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-b6b484b1-764d-4dc1-964e-b03fd1bdc8f4 req-fb002355-0103-46d6-b646-835f9265558d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034111 Apr 18 14:35:16 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 88/261] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:35:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:35:16 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-f1d05ceb-2c3a-4541-bce6-19c3979a60f0 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae2d60ff00f4be59827e15aece5d8c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b30ff7e42a496fa0abfb7102e9c0b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:35:16 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-f1d05ceb-2c3a-4541-bce6-19c3979a60f0 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f" status: 200 len: 1540 microversion: 2.1 time: 0.403501 Apr 18 14:35:16 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 86/262] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:35:16 2023] GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f => generated 1540 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:35:18 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-a3503f5d-cf4b-44f8-ad5c-c7774d2695e8 req-f48e86af-faaf-47ae-8adf-4fc6d4528307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a78d1f-313b-4957-8a3f-75244b0b242f", "name": "network-vif-plugged", "status": "completed", "tag": "05bb8b6c-a9cd-4476-86f7-66825eefc586"}, {"server_uuid": "b6a78d1f-313b-4957-8a3f-75244b0b242f", "name": "network-vif-deleted", "tag": "05bb8b6c-a9cd-4476-86f7-66825eefc586"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:18 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-a3503f5d-cf4b-44f8-ad5c-c7774d2695e8 req-f48e86af-faaf-47ae-8adf-4fc6d4528307 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:18 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-a3503f5d-cf4b-44f8-ad5c-c7774d2695e8 req-f48e86af-faaf-47ae-8adf-4fc6d4528307 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:18 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-a3503f5d-cf4b-44f8-ad5c-c7774d2695e8 req-f48e86af-faaf-47ae-8adf-4fc6d4528307 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:18 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-a3503f5d-cf4b-44f8-ad5c-c7774d2695e8 req-f48e86af-faaf-47ae-8adf-4fc6d4528307 service nova] Creating event network-vif-plugged:05bb8b6c-a9cd-4476-86f7-66825eefc586 for instance b6a78d1f-313b-4957-8a3f-75244b0b242f on user Apr 18 14:35:18 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-a3503f5d-cf4b-44f8-ad5c-c7774d2695e8 req-f48e86af-faaf-47ae-8adf-4fc6d4528307 service nova] Creating event network-vif-deleted:05bb8b6c-a9cd-4476-86f7-66825eefc586 for instance b6a78d1f-313b-4957-8a3f-75244b0b242f on user Apr 18 14:35:18 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-a3503f5d-cf4b-44f8-ad5c-c7774d2695e8 req-f48e86af-faaf-47ae-8adf-4fc6d4528307 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029433 Apr 18 14:35:18 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 89/263] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:35:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:35:27 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=8 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:27 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=16 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:27 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1285261546", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "networks": [{"uuid": "88bea57e-6871-4fb1-83dc-1a8f33b7ab4d"}]}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:27 user devstack@n-api.service[61310]: DEBUG nova.network.neutron [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] validate_networks() for [('88bea57e-6871-4fb1-83dc-1a8f33b7ab4d', None, None, None, None, None)] {{(pid=61310) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Flavor limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Image limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Flavor pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Image pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Getting quotas for project 7a59feb1aea84dbf8baeaa24872f23a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Getting quotas for user 0953591cb5174b66a333e9740b50c32e and project 7a59feb1aea84dbf8baeaa24872f23a5. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Going to run 1 instances... {{(pid=61310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:35:28 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] [instance: 08df03c8-06e2-487f-811b-32f1a244ab39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:35:28 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-ffab7618-fc45-47ad-8a0c-9445b216044c tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.763273 Apr 18 14:35:28 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 89/264] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:35:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:35:28 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-65e32fd5-d5fe-4427-a450-a04bdb2e7416 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:28 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-65e32fd5-d5fe-4427-a450-a04bdb2e7416 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] [instance: 08df03c8-06e2-487f-811b-32f1a244ab39] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:28 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:28 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:28 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=18 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:28 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-65e32fd5-d5fe-4427-a450-a04bdb2e7416 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0953591cb5174b66a333e9740b50c32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a59feb1aea84dbf8baeaa24872f23a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:35:28 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-65e32fd5-d5fe-4427-a450-a04bdb2e7416 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08df03c8-06e2-487f-811b-32f1a244ab39" status: 200 len: 1209 microversion: 2.1 time: 0.075335 Apr 18 14:35:28 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 87/265] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:35:28 2023] GET /compute/v2.1/servers/08df03c8-06e2-487f-811b-32f1a244ab39 => generated 1209 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:35:30 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:30 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:30 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-8d7f06b3-a709-4f6c-bfb6-d274ae5ee7da req-1ad1ae44-0e39-4067-93f1-1a6e0a26fb28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08df03c8-06e2-487f-811b-32f1a244ab39", "tag": "4756b1cd-35f1-4c2c-86d7-30112289c802"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8d7f06b3-a709-4f6c-bfb6-d274ae5ee7da req-1ad1ae44-0e39-4067-93f1-1a6e0a26fb28 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8d7f06b3-a709-4f6c-bfb6-d274ae5ee7da req-1ad1ae44-0e39-4067-93f1-1a6e0a26fb28 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8d7f06b3-a709-4f6c-bfb6-d274ae5ee7da req-1ad1ae44-0e39-4067-93f1-1a6e0a26fb28 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:30 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-8d7f06b3-a709-4f6c-bfb6-d274ae5ee7da req-1ad1ae44-0e39-4067-93f1-1a6e0a26fb28 service nova] Creating event network-changed:4756b1cd-35f1-4c2c-86d7-30112289c802 for instance 08df03c8-06e2-487f-811b-32f1a244ab39 on user Apr 18 14:35:30 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-8d7f06b3-a709-4f6c-bfb6-d274ae5ee7da req-1ad1ae44-0e39-4067-93f1-1a6e0a26fb28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034599 Apr 18 14:35:30 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 90/266] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:35:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:35:32 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-a2e82d34-7e05-44fa-b4c6-56827c0fed49 req-c0997470-8666-4ddd-ae36-f6cc1547a48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08df03c8-06e2-487f-811b-32f1a244ab39", "name": "network-vif-plugged", "status": "completed", "tag": "4756b1cd-35f1-4c2c-86d7-30112289c802"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:32 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-a2e82d34-7e05-44fa-b4c6-56827c0fed49 req-c0997470-8666-4ddd-ae36-f6cc1547a48a service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:32 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-a2e82d34-7e05-44fa-b4c6-56827c0fed49 req-c0997470-8666-4ddd-ae36-f6cc1547a48a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:32 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-a2e82d34-7e05-44fa-b4c6-56827c0fed49 req-c0997470-8666-4ddd-ae36-f6cc1547a48a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:32 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-a2e82d34-7e05-44fa-b4c6-56827c0fed49 req-c0997470-8666-4ddd-ae36-f6cc1547a48a service nova] Creating event network-vif-plugged:4756b1cd-35f1-4c2c-86d7-30112289c802 for instance 08df03c8-06e2-487f-811b-32f1a244ab39 on user Apr 18 14:35:32 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-a2e82d34-7e05-44fa-b4c6-56827c0fed49 req-c0997470-8666-4ddd-ae36-f6cc1547a48a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033436 Apr 18 14:35:32 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 90/267] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:35:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:35:34 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-7bf7ad40-27c2-4f28-8e94-f22f72d075dc req-1db4d527-10e5-4965-aec6-843657ad3894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08df03c8-06e2-487f-811b-32f1a244ab39", "name": "network-vif-plugged", "status": "completed", "tag": "4756b1cd-35f1-4c2c-86d7-30112289c802"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:34 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-7bf7ad40-27c2-4f28-8e94-f22f72d075dc req-1db4d527-10e5-4965-aec6-843657ad3894 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:34 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-7bf7ad40-27c2-4f28-8e94-f22f72d075dc req-1db4d527-10e5-4965-aec6-843657ad3894 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:34 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-7bf7ad40-27c2-4f28-8e94-f22f72d075dc req-1db4d527-10e5-4965-aec6-843657ad3894 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:34 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-7bf7ad40-27c2-4f28-8e94-f22f72d075dc req-1db4d527-10e5-4965-aec6-843657ad3894 service nova] Creating event network-vif-plugged:4756b1cd-35f1-4c2c-86d7-30112289c802 for instance 08df03c8-06e2-487f-811b-32f1a244ab39 on user Apr 18 14:35:34 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-7bf7ad40-27c2-4f28-8e94-f22f72d075dc req-1db4d527-10e5-4965-aec6-843657ad3894 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032788 Apr 18 14:35:34 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 88/268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:35:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:35:37 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-8f2c6fc1-ebce-465b-aac5-41d452d31fb3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:37 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-8f2c6fc1-ebce-465b-aac5-41d452d31fb3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] [instance: 1b067df0-2ea8-44e6-9418-98788edf4e7d] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-8f2c6fc1-ebce-465b-aac5-41d452d31fb3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-8f2c6fc1-ebce-465b-aac5-41d452d31fb3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-8f2c6fc1-ebce-465b-aac5-41d452d31fb3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-8f2c6fc1-ebce-465b-aac5-41d452d31fb3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-8f2c6fc1-ebce-465b-aac5-41d452d31fb3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-8f2c6fc1-ebce-465b-aac5-41d452d31fb3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:37 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-8f2c6fc1-ebce-465b-aac5-41d452d31fb3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] HTTP exception thrown: Instance 1b067df0-2ea8-44e6-9418-98788edf4e7d could not be found. Apr 18 14:35:37 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-8f2c6fc1-ebce-465b-aac5-41d452d31fb3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Request method failure captured: Apr 18 14:35:37 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/1b067df0-2ea8-44e6-9418-98788edf4e7d HTTP/1.1 Apr 18 14:35:37 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:35:37 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:35:37 user devstack@n-api.service[61309]: Connection: close Apr 18 14:35:37 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:35:37 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:35:37 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:35:37 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:35:37 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqkwZc8sXDQaY50C0khcH2-lJy4JcRieYQA09aNuMqZMylGT-jKIghEgotO9ozxnyMbfTUwNHBDxR1-5E0_sPHrDv7HSbPocG-Gjph3IMWKeSGiW-lZY-mT00xXRvI5FTBDHOIu0e0MD83hbqZe6UeKVHxFfhRR3tap7BotGUo-VDFk Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Project-Id: e4ca11d8beec4410a8a4c8ae7c8e4bed Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1890610007 Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4ca11d8beec4410a8a4c8ae7c8e4bed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4ca11d8beec4410a8a4c8ae7c8e4bed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4ca11d8beec4410a8a4c8ae7c8e4bed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1890610007 Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Tenant-Id: e4ca11d8beec4410a8a4c8ae7c8e4bed Apr 18 14:35:37 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1890610007 Apr 18 14:35:37 user devstack@n-api.service[61309]: X-User: tempest-ServerRescueNegativeTestJSON-1890610007-project-member Apr 18 14:35:37 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:35:37 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:35:37 user devstack@n-api.service[61309]: X-User-Id: 7e284b794c4043768af56fd58fceb837 Apr 18 14:35:37 user devstack@n-api.service[61309]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1890610007-project-member Apr 18 14:35:37 user devstack@n-api.service[61309]: method: > Apr 18 14:35:37 user devstack@n-api.service[61309]: exception: Instance 1b067df0-2ea8-44e6-9418-98788edf4e7d could not be found. Apr 18 14:35:37 user devstack@n-api.service[61309]: action_args: {'id': '1b067df0-2ea8-44e6-9418-98788edf4e7d'} Apr 18 14:35:37 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b067df0-2ea8-44e6-9418-98788edf4e7d could not be found. Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b067df0-2ea8-44e6-9418-98788edf4e7d could not be found. Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b067df0-2ea8-44e6-9418-98788edf4e7d could not be found. Apr 18 14:35:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:35:37 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-8f2c6fc1-ebce-465b-aac5-41d452d31fb3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] Returning 404 to user: Instance 1b067df0-2ea8-44e6-9418-98788edf4e7d could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:35:37 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-8f2c6fc1-ebce-465b-aac5-41d452d31fb3 tempest-ServerRescueNegativeTestJSON-1890610007 tempest-ServerRescueNegativeTestJSON-1890610007-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b067df0-2ea8-44e6-9418-98788edf4e7d" status: 404 len: 111 microversion: 2.1 time: 0.032803 Apr 18 14:35:37 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 91/269] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:35:37 2023] GET /compute/v2.1/servers/1b067df0-2ea8-44e6-9418-98788edf4e7d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:35:47 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:47 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:47 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:47 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:47 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-dd2660f3-7caf-4117-9e61-989ca7f55a19 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:47 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-dd2660f3-7caf-4117-9e61-989ca7f55a19 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: e5323297-c840-4fd6-9a76-727ed36de870] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:47 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-dd2660f3-7caf-4117-9e61-989ca7f55a19 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:47 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-dd2660f3-7caf-4117-9e61-989ca7f55a19 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:47 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-dd2660f3-7caf-4117-9e61-989ca7f55a19 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:47 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-dd2660f3-7caf-4117-9e61-989ca7f55a19 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:47 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-dd2660f3-7caf-4117-9e61-989ca7f55a19 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:47 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-dd2660f3-7caf-4117-9e61-989ca7f55a19 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:48 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:48 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:48 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:48 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-b11fd6e2-a459-4756-8da1-9c75a528e2b3 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Action: 'create', calling method: .version_select at 0x7f5cee94ea70>, body: {"keypair": {"name": "tempest-keypair-136376707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjqqTV+CoRoxtZMs7AKuFCVV3P0fRLdtyeeiSDFd7oDb5FjuLqSpIeiLLYRJJnubjNLUfUvapeRUv0Wq1HK73r4ymV8iU/EsENjrOPxF3az7WYjjSfqjVOvBDcy0j/qbQ=="}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:48 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-b11fd6e2-a459-4756-8da1-9c75a528e2b3 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Getting quotas for project e38cf2921e9c49b98933eb439c2ea431. Resources: {'key_pairs'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:35:48 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-b11fd6e2-a459-4756-8da1-9c75a528e2b3 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Getting quotas for user 43dd536529724c41980d5f2fddd8c71d and project e38cf2921e9c49b98933eb439c2ea431. Resources: {'key_pairs'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:35:48 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-b11fd6e2-a459-4756-8da1-9c75a528e2b3 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156707 Apr 18 14:35:48 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 89/270] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:35:48 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:35:48 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-dd2660f3-7caf-4117-9e61-989ca7f55a19 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b209357fca7f40c0b52507a285e054e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312c2b6e41142799cb66dd1377558d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:35:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-dd2660f3-7caf-4117-9e61-989ca7f55a19 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870" status: 200 len: 1493 microversion: 2.1 time: 0.332246 Apr 18 14:35:48 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 91/271] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:35:47 2023] GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870 => generated 1493 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:35:49 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-231547224", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "241eb4cb-7a63-47fa-873a-79cdcab7a582"}], "security_groups": [{"name": "tempest-securitygroup--1775621931"}], "key_name": "tempest-keypair-136376707", "user_data": "}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:49 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=4 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:49 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=4 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:35:49 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] validate_networks() for [('241eb4cb-7a63-47fa-873a-79cdcab7a582', None, None, None, None, None)] {{(pid=61309) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Flavor limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Image limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Flavor pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Image pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Getting quotas for project e38cf2921e9c49b98933eb439c2ea431. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Getting quotas for user 43dd536529724c41980d5f2fddd8c71d and project e38cf2921e9c49b98933eb439c2ea431. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Going to run 1 instances... {{(pid=61309) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:35:50 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 84ecf5bb-f207-4523-bb55-fb147ede0570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61309) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:35:50 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-50e4fcaf-7cc9-4660-8bb1-6c437afdf697 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.704921 Apr 18 14:35:50 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 92/272] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:35:49 2023] POST /compute/v2.1/servers => generated 400 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:35:50 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-24c2b559-de4c-4a04-ab4b-70a542638a0f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:50 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-24c2b559-de4c-4a04-ab4b-70a542638a0f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 84ecf5bb-f207-4523-bb55-fb147ede0570] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:50 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-24c2b559-de4c-4a04-ab4b-70a542638a0f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd536529724c41980d5f2fddd8c71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38cf2921e9c49b98933eb439c2ea431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:35:50 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-24c2b559-de4c-4a04-ab4b-70a542638a0f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570" status: 200 len: 1234 microversion: 2.1 time: 0.072931 Apr 18 14:35:50 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 90/273] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:35:50 2023] GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570 => generated 1234 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:35:53 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-6989de21-18fa-4cc0-8e80-91c0815ff5c3 req-dbfa6cb6-40e7-442d-801a-60847d0a2cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ecf5bb-f207-4523-bb55-fb147ede0570", "tag": "1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:53 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-6989de21-18fa-4cc0-8e80-91c0815ff5c3 req-dbfa6cb6-40e7-442d-801a-60847d0a2cb4 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:53 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-6989de21-18fa-4cc0-8e80-91c0815ff5c3 req-dbfa6cb6-40e7-442d-801a-60847d0a2cb4 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:53 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-6989de21-18fa-4cc0-8e80-91c0815ff5c3 req-dbfa6cb6-40e7-442d-801a-60847d0a2cb4 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:53 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-6989de21-18fa-4cc0-8e80-91c0815ff5c3 req-dbfa6cb6-40e7-442d-801a-60847d0a2cb4 service nova] Creating event network-changed:1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71 for instance 84ecf5bb-f207-4523-bb55-fb147ede0570 on user Apr 18 14:35:53 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-6989de21-18fa-4cc0-8e80-91c0815ff5c3 req-dbfa6cb6-40e7-442d-801a-60847d0a2cb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028620 Apr 18 14:35:53 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 92/274] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:35:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:35:55 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-32d3acd9-13e9-445e-b2fa-232813c51778 req-b5d7c218-7902-472b-b5d2-0fb5ae13b81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ecf5bb-f207-4523-bb55-fb147ede0570", "name": "network-vif-plugged", "status": "completed", "tag": "1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:55 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-32d3acd9-13e9-445e-b2fa-232813c51778 req-b5d7c218-7902-472b-b5d2-0fb5ae13b81a service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:55 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-32d3acd9-13e9-445e-b2fa-232813c51778 req-b5d7c218-7902-472b-b5d2-0fb5ae13b81a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:55 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-32d3acd9-13e9-445e-b2fa-232813c51778 req-b5d7c218-7902-472b-b5d2-0fb5ae13b81a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:55 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-32d3acd9-13e9-445e-b2fa-232813c51778 req-b5d7c218-7902-472b-b5d2-0fb5ae13b81a service nova] Creating event network-vif-plugged:1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71 for instance 84ecf5bb-f207-4523-bb55-fb147ede0570 on user Apr 18 14:35:55 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-32d3acd9-13e9-445e-b2fa-232813c51778 req-b5d7c218-7902-472b-b5d2-0fb5ae13b81a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034349 Apr 18 14:35:55 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 93/275] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:35:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:35:57 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-df7b34a3-5e04-4980-a57c-95e4ca18f876 req-37672584-c26b-493b-ae8b-abdcb50b28e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ecf5bb-f207-4523-bb55-fb147ede0570", "name": "network-vif-plugged", "status": "completed", "tag": "1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:35:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-df7b34a3-5e04-4980-a57c-95e4ca18f876 req-37672584-c26b-493b-ae8b-abdcb50b28e8 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-df7b34a3-5e04-4980-a57c-95e4ca18f876 req-37672584-c26b-493b-ae8b-abdcb50b28e8 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:57 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-df7b34a3-5e04-4980-a57c-95e4ca18f876 req-37672584-c26b-493b-ae8b-abdcb50b28e8 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:57 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-df7b34a3-5e04-4980-a57c-95e4ca18f876 req-37672584-c26b-493b-ae8b-abdcb50b28e8 service nova] Creating event network-vif-plugged:1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71 for instance 84ecf5bb-f207-4523-bb55-fb147ede0570 on user Apr 18 14:35:57 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-df7b34a3-5e04-4980-a57c-95e4ca18f876 req-37672584-c26b-493b-ae8b-abdcb50b28e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034747 Apr 18 14:35:57 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 91/276] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:35:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:35:58 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-2dbc93ac-aa4a-42b7-aa81-6c2fd25409fc tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '.version_select at 0x7f5ceeafbac0>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:58 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-2dbc93ac-aa4a-42b7-aa81-6c2fd25409fc tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "GET /compute/v2.1/images/a0410ede-d99d-41ed-b0a2-292d19cd7f10" status: 200 len: 1720 microversion: 2.1 time: 0.050446 Apr 18 14:35:58 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 93/277] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 14:35:58 2023] GET /compute/v2.1/images/a0410ede-d99d-41ed-b0a2-292d19cd7f10 => generated 1720 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:35:58 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-ee40931a-c16d-49b0-b58d-d89466ec52bd tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '.version_select at 0x7f5ceea06830>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:58 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-ee40931a-c16d-49b0-b58d-d89466ec52bd tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "GET /compute/v2.1/images/a0410ede-d99d-41ed-b0a2-292d19cd7f10" status: 200 len: 1720 microversion: 2.1 time: 0.064847 Apr 18 14:35:58 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 94/278] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 14:35:58 2023] GET /compute/v2.1/images/a0410ede-d99d-41ed-b0a2-292d19cd7f10 => generated 1720 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:35:58 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-dce260f2-35e3-49c1-8985-27f7bf62871d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:35:58 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-dce260f2-35e3-49c1-8985-27f7bf62871d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] [instance: 6795fad9-3f0a-430b-8319-a3c6025122c3] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:35:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dce260f2-35e3-49c1-8985-27f7bf62871d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dce260f2-35e3-49c1-8985-27f7bf62871d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dce260f2-35e3-49c1-8985-27f7bf62871d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dce260f2-35e3-49c1-8985-27f7bf62871d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:35:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dce260f2-35e3-49c1-8985-27f7bf62871d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:35:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dce260f2-35e3-49c1-8985-27f7bf62871d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:35:58 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-dce260f2-35e3-49c1-8985-27f7bf62871d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53a60dd2a8ca42b391d4584accb60b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5667da319fd405e96f277368203a72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:35:58 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-dce260f2-35e3-49c1-8985-27f7bf62871d tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3" status: 200 len: 1672 microversion: 2.1 time: 0.230880 Apr 18 14:35:58 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 92/279] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:35:58 2023] GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3 => generated 1672 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:36:06 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:06 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=8 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:06 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-5d5e3316-d883-4c2e-a785-515d5cd2dd8c tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:36:06 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-5d5e3316-d883-4c2e-a785-515d5cd2dd8c tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] [instance: b6a78d1f-313b-4957-8a3f-75244b0b242f] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:36:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-5d5e3316-d883-4c2e-a785-515d5cd2dd8c tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-5d5e3316-d883-4c2e-a785-515d5cd2dd8c tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-5d5e3316-d883-4c2e-a785-515d5cd2dd8c tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-5d5e3316-d883-4c2e-a785-515d5cd2dd8c tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-5d5e3316-d883-4c2e-a785-515d5cd2dd8c tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-5d5e3316-d883-4c2e-a785-515d5cd2dd8c tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:06 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-5d5e3316-d883-4c2e-a785-515d5cd2dd8c tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] HTTP exception thrown: Instance b6a78d1f-313b-4957-8a3f-75244b0b242f could not be found. Apr 18 14:36:06 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-5d5e3316-d883-4c2e-a785-515d5cd2dd8c tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Request method failure captured: Apr 18 14:36:06 user devstack@n-api.service[61310]: request: GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f HTTP/1.1 Apr 18 14:36:06 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:36:06 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:36:06 user devstack@n-api.service[61310]: Connection: close Apr 18 14:36:06 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:36:06 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:36:06 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:36:06 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:36:06 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqmBOREvdVgPkeex88b6G1mE0T-WeIfcK2Yw4ktTbC8cwlwIyUW_455k9l0o-gl0OltznbJr03B8n5RpGVc3KqqU2vleLyOY6N5iiuCY-jd_TjNym8h-WI1RTb2uAcBQcffjKXv3xJbFmm78CjDXXqsWSezvbsn20r95GrvPKmuwuSQ Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Project-Id: 37b30ff7e42a496fa0abfb7102e9c0b8 Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Project-Name: tempest-TestMinimumBasicScenario-317059403 Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b30ff7e42a496fa0abfb7102e9c0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37b30ff7e42a496fa0abfb7102e9c0b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37b30ff7e42a496fa0abfb7102e9c0b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Tenant: tempest-TestMinimumBasicScenario-317059403 Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Tenant-Id: 37b30ff7e42a496fa0abfb7102e9c0b8 Apr 18 14:36:06 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-TestMinimumBasicScenario-317059403 Apr 18 14:36:06 user devstack@n-api.service[61310]: X-User: tempest-TestMinimumBasicScenario-317059403-project-member Apr 18 14:36:06 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:36:06 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:36:06 user devstack@n-api.service[61310]: X-User-Id: 6ae2d60ff00f4be59827e15aece5d8c4 Apr 18 14:36:06 user devstack@n-api.service[61310]: X-User-Name: tempest-TestMinimumBasicScenario-317059403-project-member Apr 18 14:36:06 user devstack@n-api.service[61310]: method: > Apr 18 14:36:06 user devstack@n-api.service[61310]: exception: Instance b6a78d1f-313b-4957-8a3f-75244b0b242f could not be found. Apr 18 14:36:06 user devstack@n-api.service[61310]: action_args: {'id': 'b6a78d1f-313b-4957-8a3f-75244b0b242f'} Apr 18 14:36:06 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a78d1f-313b-4957-8a3f-75244b0b242f could not be found. Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a78d1f-313b-4957-8a3f-75244b0b242f could not be found. Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a78d1f-313b-4957-8a3f-75244b0b242f could not be found. Apr 18 14:36:06 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:36:06 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-5d5e3316-d883-4c2e-a785-515d5cd2dd8c tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Returning 404 to user: Instance b6a78d1f-313b-4957-8a3f-75244b0b242f could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:36:06 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-5d5e3316-d883-4c2e-a785-515d5cd2dd8c tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f" status: 404 len: 111 microversion: 2.1 time: 0.165160 Apr 18 14:36:06 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 94/280] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:36:06 2023] GET /compute/v2.1/servers/b6a78d1f-313b-4957-8a3f-75244b0b242f => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:36:06 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:06 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:06 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:06 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=4 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:06 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-4ba754df-f5b2-4a73-9b0a-a6fa54907131 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] Calling method '.version_select at 0x7f5cee9d9360>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:36:06 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-4ba754df-f5b2-4a73-9b0a-a6fa54907131 tempest-TestMinimumBasicScenario-317059403 tempest-TestMinimumBasicScenario-317059403-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-68293471" status: 202 len: 0 microversion: 2.1 time: 0.031060 Apr 18 14:36:06 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 95/281] 10.0.0.210 () {62 vars in 1343 bytes} [Tue Apr 18 14:36:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-68293471 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:36:11 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-a20329c4-302c-4c71-9f4f-222845329f0e tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:36:11 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-a20329c4-302c-4c71-9f4f-222845329f0e tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:36:11 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:11 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:11 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=8 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:11 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-a20329c4-302c-4c71-9f4f-222845329f0e tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:11 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-a20329c4-302c-4c71-9f4f-222845329f0e tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:11 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-a20329c4-302c-4c71-9f4f-222845329f0e tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:11 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-a20329c4-302c-4c71-9f4f-222845329f0e tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:11 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-a20329c4-302c-4c71-9f4f-222845329f0e tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:11 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-a20329c4-302c-4c71-9f4f-222845329f0e tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:12 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-a20329c4-302c-4c71-9f4f-222845329f0e tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:36:12 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-a20329c4-302c-4c71-9f4f-222845329f0e tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1656 microversion: 2.1 time: 0.280230 Apr 18 14:36:12 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 93/282] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:36:11 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1656 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:36:12 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-c0c50851-a203-49e3-a7cb-1fd0a0f2de3b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:36:12 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-c0c50851-a203-49e3-a7cb-1fd0a0f2de3b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:36:12 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c0c50851-a203-49e3-a7cb-1fd0a0f2de3b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:12 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c0c50851-a203-49e3-a7cb-1fd0a0f2de3b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:12 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c0c50851-a203-49e3-a7cb-1fd0a0f2de3b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:12 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c0c50851-a203-49e3-a7cb-1fd0a0f2de3b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:12 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c0c50851-a203-49e3-a7cb-1fd0a0f2de3b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:12 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c0c50851-a203-49e3-a7cb-1fd0a0f2de3b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:12 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-c0c50851-a203-49e3-a7cb-1fd0a0f2de3b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:36:12 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-c0c50851-a203-49e3-a7cb-1fd0a0f2de3b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1656 microversion: 2.1 time: 0.417824 Apr 18 14:36:12 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 95/283] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:36:12 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1656 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:36:12 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-3c5c0956-6d82-40f8-a219-17804d3458e8 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:36:12 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-3c5c0956-6d82-40f8-a219-17804d3458e8 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:36:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-3c5c0956-6d82-40f8-a219-17804d3458e8 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-3c5c0956-6d82-40f8-a219-17804d3458e8 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-3c5c0956-6d82-40f8-a219-17804d3458e8 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-3c5c0956-6d82-40f8-a219-17804d3458e8 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-3c5c0956-6d82-40f8-a219-17804d3458e8 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:12 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-3c5c0956-6d82-40f8-a219-17804d3458e8 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:12 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-3c5c0956-6d82-40f8-a219-17804d3458e8 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:36:12 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-3c5c0956-6d82-40f8-a219-17804d3458e8 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1656 microversion: 2.1 time: 0.286904 Apr 18 14:36:12 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 96/284] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:36:12 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1656 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:36:18 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ba83ac72-0fd3-4513-924e-6cbb5cced0a3 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:36:18 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-ba83ac72-0fd3-4513-924e-6cbb5cced0a3 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] [instance: 08df03c8-06e2-487f-811b-32f1a244ab39] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:36:18 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ba83ac72-0fd3-4513-924e-6cbb5cced0a3 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:18 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ba83ac72-0fd3-4513-924e-6cbb5cced0a3 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:18 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ba83ac72-0fd3-4513-924e-6cbb5cced0a3 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:18 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ba83ac72-0fd3-4513-924e-6cbb5cced0a3 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:18 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ba83ac72-0fd3-4513-924e-6cbb5cced0a3 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:18 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ba83ac72-0fd3-4513-924e-6cbb5cced0a3 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:18 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-ba83ac72-0fd3-4513-924e-6cbb5cced0a3 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0953591cb5174b66a333e9740b50c32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a59feb1aea84dbf8baeaa24872f23a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:36:18 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ba83ac72-0fd3-4513-924e-6cbb5cced0a3 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08df03c8-06e2-487f-811b-32f1a244ab39" status: 200 len: 1490 microversion: 2.1 time: 0.353962 Apr 18 14:36:18 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 94/285] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:36:18 2023] GET /compute/v2.1/servers/08df03c8-06e2-487f-811b-32f1a244ab39 => generated 1490 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:36:32 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-cac0c993-774d-48a9-85c2-b921cc5629ca tempest-TestVolumeBootPattern-347921614 tempest-TestVolumeBootPattern-347921614-project-member] Action: 'create', calling method: .version_select at 0x7f5ceeafab00>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-596647979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGRCxrmSUBRWPIAKbbhF1XOBWHdI4h7q8kZEfNDhQwmzOI8szx5aC5Dz6f1cJ8MlvXTmrhkYxVxgIjMU1VdRQRO4yKFA3UFhJYB4U0GvAKcqpGhFK9nQ1JcEPaPJWTpeg=="}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:36:32 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:32 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=8 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:32 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-cac0c993-774d-48a9-85c2-b921cc5629ca tempest-TestVolumeBootPattern-347921614 tempest-TestVolumeBootPattern-347921614-project-member] Getting quotas for project 484efe667f124e1ebf74b72df194f027. Resources: {'key_pairs'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:36:32 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-cac0c993-774d-48a9-85c2-b921cc5629ca tempest-TestVolumeBootPattern-347921614 tempest-TestVolumeBootPattern-347921614-project-member] Getting quotas for user 2143465bd1944b78bb4915c5178bb43d and project 484efe667f124e1ebf74b72df194f027. Resources: {'key_pairs'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:36:32 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-cac0c993-774d-48a9-85c2-b921cc5629ca tempest-TestVolumeBootPattern-347921614 tempest-TestVolumeBootPattern-347921614-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.052107 Apr 18 14:36:32 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 96/286] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:36:32 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:36:35 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-9662dd0c-646e-4acd-9c44-775a2915ff1f tempest-TestVolumeBootPattern-347921614 tempest-TestVolumeBootPattern-347921614-project-member] Calling method '.version_select at 0x7f5cee9d93f0>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:36:35 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:35 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:35 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-9662dd0c-646e-4acd-9c44-775a2915ff1f tempest-TestVolumeBootPattern-347921614 tempest-TestVolumeBootPattern-347921614-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-596647979" status: 202 len: 0 microversion: 2.1 time: 0.023881 Apr 18 14:36:35 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 97/287] 10.0.0.210 () {62 vars in 1337 bytes} [Tue Apr 18 14:36:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-596647979 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:36:40 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-47d8a059-67f8-45b0-875c-ca95125115df tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:36:40 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-47d8a059-67f8-45b0-875c-ca95125115df tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 84ecf5bb-f207-4523-bb55-fb147ede0570] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:36:40 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:40 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=12 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-47d8a059-67f8-45b0-875c-ca95125115df tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-47d8a059-67f8-45b0-875c-ca95125115df tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-47d8a059-67f8-45b0-875c-ca95125115df tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-47d8a059-67f8-45b0-875c-ca95125115df tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-47d8a059-67f8-45b0-875c-ca95125115df tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-47d8a059-67f8-45b0-875c-ca95125115df tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:40 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-47d8a059-67f8-45b0-875c-ca95125115df tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd536529724c41980d5f2fddd8c71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38cf2921e9c49b98933eb439c2ea431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:36:40 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-47d8a059-67f8-45b0-875c-ca95125115df tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570" status: 200 len: 1545 microversion: 2.1 time: 0.303810 Apr 18 14:36:40 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 95/288] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:36:40 2023] GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570 => generated 1545 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 14:36:49 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:49 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:49 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-9fb36c7a-cc04-49d8-8252-177b5a5e489c tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:36:49 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-9fb36c7a-cc04-49d8-8252-177b5a5e489c tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: e5323297-c840-4fd6-9a76-727ed36de870] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:36:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9fb36c7a-cc04-49d8-8252-177b5a5e489c tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9fb36c7a-cc04-49d8-8252-177b5a5e489c tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9fb36c7a-cc04-49d8-8252-177b5a5e489c tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9fb36c7a-cc04-49d8-8252-177b5a5e489c tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9fb36c7a-cc04-49d8-8252-177b5a5e489c tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-9fb36c7a-cc04-49d8-8252-177b5a5e489c tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:49 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-9fb36c7a-cc04-49d8-8252-177b5a5e489c tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b209357fca7f40c0b52507a285e054e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312c2b6e41142799cb66dd1377558d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:36:49 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-9fb36c7a-cc04-49d8-8252-177b5a5e489c tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870" status: 200 len: 1493 microversion: 2.1 time: 0.251812 Apr 18 14:36:49 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 97/289] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:36:49 2023] GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870 => generated 1493 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 14:36:59 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-b3e168c1-0edf-4b2b-946e-92dfb007dec4 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:36:59 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-b3e168c1-0edf-4b2b-946e-92dfb007dec4 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] [instance: 6795fad9-3f0a-430b-8319-a3c6025122c3] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:36:59 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:36:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b3e168c1-0edf-4b2b-946e-92dfb007dec4 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b3e168c1-0edf-4b2b-946e-92dfb007dec4 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b3e168c1-0edf-4b2b-946e-92dfb007dec4 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b3e168c1-0edf-4b2b-946e-92dfb007dec4 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:36:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b3e168c1-0edf-4b2b-946e-92dfb007dec4 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:36:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-b3e168c1-0edf-4b2b-946e-92dfb007dec4 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:36:59 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-b3e168c1-0edf-4b2b-946e-92dfb007dec4 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53a60dd2a8ca42b391d4584accb60b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5667da319fd405e96f277368203a72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:36:59 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-b3e168c1-0edf-4b2b-946e-92dfb007dec4 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3" status: 200 len: 1672 microversion: 2.1 time: 0.221475 Apr 18 14:36:59 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 98/290] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:36:59 2023] GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3 => generated 1672 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:37:00 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-135a109e-1bd2-4681-b1fe-2892c732844e tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '.version_select at 0x7f5cee94f7f0>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:00 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:00 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:00 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-135a109e-1bd2-4681-b1fe-2892c732844e tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/a0410ede-d99d-41ed-b0a2-292d19cd7f10" status: 204 len: 0 microversion: 2.1 time: 0.193456 Apr 18 14:37:00 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 96/291] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:37:00 2023] DELETE /compute/v2.1/images/a0410ede-d99d-41ed-b0a2-292d19cd7f10 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:37:00 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-6e1c26ea-fbdd-4dbd-ae62-d9521ad38ce0 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:00 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-6e1c26ea-fbdd-4dbd-ae62-d9521ad38ce0 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] [instance: 6795fad9-3f0a-430b-8319-a3c6025122c3] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:00 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:00 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:00 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-6e1c26ea-fbdd-4dbd-ae62-d9521ad38ce0 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:00 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-6e1c26ea-fbdd-4dbd-ae62-d9521ad38ce0 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:00 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-6e1c26ea-fbdd-4dbd-ae62-d9521ad38ce0 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:00 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-6e1c26ea-fbdd-4dbd-ae62-d9521ad38ce0 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:01 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-6e1c26ea-fbdd-4dbd-ae62-d9521ad38ce0 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:01 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-6e1c26ea-fbdd-4dbd-ae62-d9521ad38ce0 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:01 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-6e1c26ea-fbdd-4dbd-ae62-d9521ad38ce0 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] [instance: 6795fad9-3f0a-430b-8319-a3c6025122c3] Going to try to terminate instance {{(pid=61310) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:37:01 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-6e1c26ea-fbdd-4dbd-ae62-d9521ad38ce0 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3" status: 204 len: 0 microversion: 2.1 time: 0.123188 Apr 18 14:37:01 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 98/292] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:37:00 2023] DELETE /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:37:01 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-d5dc345e-1499-4244-ad61-682b9ccce0fa tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:01 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-d5dc345e-1499-4244-ad61-682b9ccce0fa tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] [instance: 6795fad9-3f0a-430b-8319-a3c6025122c3] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d5dc345e-1499-4244-ad61-682b9ccce0fa tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d5dc345e-1499-4244-ad61-682b9ccce0fa tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d5dc345e-1499-4244-ad61-682b9ccce0fa tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d5dc345e-1499-4244-ad61-682b9ccce0fa tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d5dc345e-1499-4244-ad61-682b9ccce0fa tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:01 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d5dc345e-1499-4244-ad61-682b9ccce0fa tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:01 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-d5dc345e-1499-4244-ad61-682b9ccce0fa tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53a60dd2a8ca42b391d4584accb60b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5667da319fd405e96f277368203a72b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:37:01 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-d5dc345e-1499-4244-ad61-682b9ccce0fa tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3" status: 200 len: 1678 microversion: 2.1 time: 0.169493 Apr 18 14:37:01 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 99/293] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:37:01 2023] GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:37:01 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-b39c5850-310c-4797-8930-52449af02bcf req-7becde5d-3356-42ba-9b32-b1166ab49ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6795fad9-3f0a-430b-8319-a3c6025122c3", "name": "network-vif-unplugged", "status": "completed", "tag": "e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:37:01 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-b39c5850-310c-4797-8930-52449af02bcf req-7becde5d-3356-42ba-9b32-b1166ab49ebd service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:01 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-b39c5850-310c-4797-8930-52449af02bcf req-7becde5d-3356-42ba-9b32-b1166ab49ebd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:01 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-b39c5850-310c-4797-8930-52449af02bcf req-7becde5d-3356-42ba-9b32-b1166ab49ebd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:01 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-b39c5850-310c-4797-8930-52449af02bcf req-7becde5d-3356-42ba-9b32-b1166ab49ebd service nova] Creating event network-vif-unplugged:e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d for instance 6795fad9-3f0a-430b-8319-a3c6025122c3 on user Apr 18 14:37:01 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-b39c5850-310c-4797-8930-52449af02bcf req-7becde5d-3356-42ba-9b32-b1166ab49ebd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031282 Apr 18 14:37:01 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 97/294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:37:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:02 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-1906bc53-2b12-445c-9eb8-238062b97764 req-108409c7-3cc4-43df-b0b6-a0076b845f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6795fad9-3f0a-430b-8319-a3c6025122c3", "name": "network-vif-deleted", "tag": "e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:37:02 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-1906bc53-2b12-445c-9eb8-238062b97764 req-108409c7-3cc4-43df-b0b6-a0076b845f44 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:02 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-1906bc53-2b12-445c-9eb8-238062b97764 req-108409c7-3cc4-43df-b0b6-a0076b845f44 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:02 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-1906bc53-2b12-445c-9eb8-238062b97764 req-108409c7-3cc4-43df-b0b6-a0076b845f44 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:02 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-1906bc53-2b12-445c-9eb8-238062b97764 req-108409c7-3cc4-43df-b0b6-a0076b845f44 service nova] Creating event network-vif-deleted:e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d for instance 6795fad9-3f0a-430b-8319-a3c6025122c3 on user Apr 18 14:37:02 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-1906bc53-2b12-445c-9eb8-238062b97764 req-108409c7-3cc4-43df-b0b6-a0076b845f44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029984 Apr 18 14:37:02 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 99/295] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:37:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:03 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-b9c96efe-4d5e-40e4-b70c-74b4ae0b2ef3 req-32bc48fa-0a55-4731-ab37-066f8f3da80f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6795fad9-3f0a-430b-8319-a3c6025122c3", "name": "network-vif-plugged", "status": "completed", "tag": "e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:37:03 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-b9c96efe-4d5e-40e4-b70c-74b4ae0b2ef3 req-32bc48fa-0a55-4731-ab37-066f8f3da80f service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:03 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-b9c96efe-4d5e-40e4-b70c-74b4ae0b2ef3 req-32bc48fa-0a55-4731-ab37-066f8f3da80f service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:03 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-b9c96efe-4d5e-40e4-b70c-74b4ae0b2ef3 req-32bc48fa-0a55-4731-ab37-066f8f3da80f service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:03 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-b9c96efe-4d5e-40e4-b70c-74b4ae0b2ef3 req-32bc48fa-0a55-4731-ab37-066f8f3da80f service nova] Creating event network-vif-plugged:e4cf6c2e-5f7f-4c1d-9b5b-fc2c786fbe9d for instance 6795fad9-3f0a-430b-8319-a3c6025122c3 on user Apr 18 14:37:03 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-b9c96efe-4d5e-40e4-b70c-74b4ae0b2ef3 req-32bc48fa-0a55-4731-ab37-066f8f3da80f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028086 Apr 18 14:37:03 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 100/296] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:37:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:14 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:14 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:14 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-d6bd5bbc-16f8-48f0-9735-5af1c2ecfe7b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:14 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-d6bd5bbc-16f8-48f0-9735-5af1c2ecfe7b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d6bd5bbc-16f8-48f0-9735-5af1c2ecfe7b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d6bd5bbc-16f8-48f0-9735-5af1c2ecfe7b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d6bd5bbc-16f8-48f0-9735-5af1c2ecfe7b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d6bd5bbc-16f8-48f0-9735-5af1c2ecfe7b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d6bd5bbc-16f8-48f0-9735-5af1c2ecfe7b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-d6bd5bbc-16f8-48f0-9735-5af1c2ecfe7b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:14 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-d6bd5bbc-16f8-48f0-9735-5af1c2ecfe7b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:37:14 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-d6bd5bbc-16f8-48f0-9735-5af1c2ecfe7b tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1656 microversion: 2.1 time: 0.240239 Apr 18 14:37:14 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 98/297] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:37:14 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1656 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:37:20 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-b528f235-24fa-4a84-9b7c-988e497fe539 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:20 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-b528f235-24fa-4a84-9b7c-988e497fe539 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] [instance: 08df03c8-06e2-487f-811b-32f1a244ab39] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:20 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:20 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:20 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-b528f235-24fa-4a84-9b7c-988e497fe539 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:20 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-b528f235-24fa-4a84-9b7c-988e497fe539 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:20 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-b528f235-24fa-4a84-9b7c-988e497fe539 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:20 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-b528f235-24fa-4a84-9b7c-988e497fe539 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:20 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-b528f235-24fa-4a84-9b7c-988e497fe539 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:20 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-b528f235-24fa-4a84-9b7c-988e497fe539 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:20 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-b528f235-24fa-4a84-9b7c-988e497fe539 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] [instance: 08df03c8-06e2-487f-811b-32f1a244ab39] Going to try to terminate instance {{(pid=61310) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:37:20 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-b528f235-24fa-4a84-9b7c-988e497fe539 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08df03c8-06e2-487f-811b-32f1a244ab39" status: 204 len: 0 microversion: 2.1 time: 0.120854 Apr 18 14:37:20 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 100/298] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:37:20 2023] DELETE /compute/v2.1/servers/08df03c8-06e2-487f-811b-32f1a244ab39 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:37:20 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:20 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=14 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:20 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-52c1c01a-f1e3-49e9-9d89-de5ac386be4e tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:20 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-52c1c01a-f1e3-49e9-9d89-de5ac386be4e tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] [instance: 08df03c8-06e2-487f-811b-32f1a244ab39] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-52c1c01a-f1e3-49e9-9d89-de5ac386be4e tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-52c1c01a-f1e3-49e9-9d89-de5ac386be4e tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-52c1c01a-f1e3-49e9-9d89-de5ac386be4e tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-52c1c01a-f1e3-49e9-9d89-de5ac386be4e tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-52c1c01a-f1e3-49e9-9d89-de5ac386be4e tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:20 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-52c1c01a-f1e3-49e9-9d89-de5ac386be4e tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:20 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-e44b8f80-c19f-4bd8-a59b-dd6cab907e61 req-46231a78-4dca-4299-b367-be6b9f40b25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08df03c8-06e2-487f-811b-32f1a244ab39", "name": "network-vif-unplugged", "status": "completed", "tag": "4756b1cd-35f1-4c2c-86d7-30112289c802"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:37:20 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-52c1c01a-f1e3-49e9-9d89-de5ac386be4e tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0953591cb5174b66a333e9740b50c32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a59feb1aea84dbf8baeaa24872f23a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:37:20 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-52c1c01a-f1e3-49e9-9d89-de5ac386be4e tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08df03c8-06e2-487f-811b-32f1a244ab39" status: 200 len: 1496 microversion: 2.1 time: 0.260625 Apr 18 14:37:20 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 101/299] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:37:20 2023] GET /compute/v2.1/servers/08df03c8-06e2-487f-811b-32f1a244ab39 => generated 1496 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:37:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-e44b8f80-c19f-4bd8-a59b-dd6cab907e61 req-46231a78-4dca-4299-b367-be6b9f40b25e service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-e44b8f80-c19f-4bd8-a59b-dd6cab907e61 req-46231a78-4dca-4299-b367-be6b9f40b25e service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:20 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-e44b8f80-c19f-4bd8-a59b-dd6cab907e61 req-46231a78-4dca-4299-b367-be6b9f40b25e service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:20 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-e44b8f80-c19f-4bd8-a59b-dd6cab907e61 req-46231a78-4dca-4299-b367-be6b9f40b25e service nova] Creating event network-vif-unplugged:4756b1cd-35f1-4c2c-86d7-30112289c802 for instance 08df03c8-06e2-487f-811b-32f1a244ab39 on user Apr 18 14:37:20 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-e44b8f80-c19f-4bd8-a59b-dd6cab907e61 req-46231a78-4dca-4299-b367-be6b9f40b25e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032604 Apr 18 14:37:20 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 99/300] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:37:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:21 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-00c83c01-4a71-4b33-9033-c311656a31d0 req-52a93b50-b91c-4e8b-a0f6-9043b1bc72de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08df03c8-06e2-487f-811b-32f1a244ab39", "name": "network-vif-deleted", "tag": "4756b1cd-35f1-4c2c-86d7-30112289c802"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:37:21 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-00c83c01-4a71-4b33-9033-c311656a31d0 req-52a93b50-b91c-4e8b-a0f6-9043b1bc72de service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:21 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-00c83c01-4a71-4b33-9033-c311656a31d0 req-52a93b50-b91c-4e8b-a0f6-9043b1bc72de service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:21 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-00c83c01-4a71-4b33-9033-c311656a31d0 req-52a93b50-b91c-4e8b-a0f6-9043b1bc72de service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:21 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-00c83c01-4a71-4b33-9033-c311656a31d0 req-52a93b50-b91c-4e8b-a0f6-9043b1bc72de service nova] Creating event network-vif-deleted:4756b1cd-35f1-4c2c-86d7-30112289c802 for instance 08df03c8-06e2-487f-811b-32f1a244ab39 on user Apr 18 14:37:21 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-00c83c01-4a71-4b33-9033-c311656a31d0 req-52a93b50-b91c-4e8b-a0f6-9043b1bc72de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040554 Apr 18 14:37:21 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 101/301] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:37:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:22 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-02ce4fbf-7a25-433a-91be-c2dd18a5a9f7 req-40683829-58f4-43f4-b47a-0ea19229b648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08df03c8-06e2-487f-811b-32f1a244ab39", "name": "network-vif-plugged", "status": "completed", "tag": "4756b1cd-35f1-4c2c-86d7-30112289c802"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:37:22 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-02ce4fbf-7a25-433a-91be-c2dd18a5a9f7 req-40683829-58f4-43f4-b47a-0ea19229b648 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:22 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-02ce4fbf-7a25-433a-91be-c2dd18a5a9f7 req-40683829-58f4-43f4-b47a-0ea19229b648 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:22 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-02ce4fbf-7a25-433a-91be-c2dd18a5a9f7 req-40683829-58f4-43f4-b47a-0ea19229b648 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:22 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-02ce4fbf-7a25-433a-91be-c2dd18a5a9f7 req-40683829-58f4-43f4-b47a-0ea19229b648 service nova] Creating event network-vif-plugged:4756b1cd-35f1-4c2c-86d7-30112289c802 for instance 08df03c8-06e2-487f-811b-32f1a244ab39 on user Apr 18 14:37:23 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-02ce4fbf-7a25-433a-91be-c2dd18a5a9f7 req-40683829-58f4-43f4-b47a-0ea19229b648 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033587 Apr 18 14:37:23 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 102/302] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:37:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:40 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:40 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=8 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:40 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-ed227eb2-0f62-4d5d-b57d-b6593d147944 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:40 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-ed227eb2-0f62-4d5d-b57d-b6593d147944 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 84ecf5bb-f207-4523-bb55-fb147ede0570] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ed227eb2-0f62-4d5d-b57d-b6593d147944 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ed227eb2-0f62-4d5d-b57d-b6593d147944 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ed227eb2-0f62-4d5d-b57d-b6593d147944 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ed227eb2-0f62-4d5d-b57d-b6593d147944 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ed227eb2-0f62-4d5d-b57d-b6593d147944 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:40 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-ed227eb2-0f62-4d5d-b57d-b6593d147944 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:41 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-ed227eb2-0f62-4d5d-b57d-b6593d147944 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.176858 Apr 18 14:37:41 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 100/303] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 14:37:40 2023] GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570/os-interface => generated 283 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:41 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:41 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:41 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-01d9d506-6970-438f-800c-e4b40c522271 req-63d82d68-d0dc-4bf2-8a58-151dffa1a4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ecf5bb-f207-4523-bb55-fb147ede0570", "tag": "1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:37:41 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-01d9d506-6970-438f-800c-e4b40c522271 req-63d82d68-d0dc-4bf2-8a58-151dffa1a4a0 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:41 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-01d9d506-6970-438f-800c-e4b40c522271 req-63d82d68-d0dc-4bf2-8a58-151dffa1a4a0 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:41 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-01d9d506-6970-438f-800c-e4b40c522271 req-63d82d68-d0dc-4bf2-8a58-151dffa1a4a0 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:41 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-01d9d506-6970-438f-800c-e4b40c522271 req-63d82d68-d0dc-4bf2-8a58-151dffa1a4a0 service nova] Creating event network-changed:1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71 for instance 84ecf5bb-f207-4523-bb55-fb147ede0570 on user Apr 18 14:37:41 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-01d9d506-6970-438f-800c-e4b40c522271 req-63d82d68-d0dc-4bf2-8a58-151dffa1a4a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042131 Apr 18 14:37:41 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 102/304] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:37:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:42 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=4 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:42 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=8 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:37:42 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-fca79a0c-a7a3-4af6-9383-8b1cb3d87b30 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:42 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-fca79a0c-a7a3-4af6-9383-8b1cb3d87b30 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 84ecf5bb-f207-4523-bb55-fb147ede0570] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-fca79a0c-a7a3-4af6-9383-8b1cb3d87b30 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-fca79a0c-a7a3-4af6-9383-8b1cb3d87b30 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-fca79a0c-a7a3-4af6-9383-8b1cb3d87b30 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-fca79a0c-a7a3-4af6-9383-8b1cb3d87b30 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-fca79a0c-a7a3-4af6-9383-8b1cb3d87b30 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-fca79a0c-a7a3-4af6-9383-8b1cb3d87b30 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:42 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-fca79a0c-a7a3-4af6-9383-8b1cb3d87b30 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570/ips" status: 200 len: 109 microversion: 2.1 time: 0.041957 Apr 18 14:37:42 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 103/305] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 14:37:42 2023] GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570/ips => generated 109 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:43 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-efc658b6-430e-4aca-9250-4f3d0107d81f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:43 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-efc658b6-430e-4aca-9250-4f3d0107d81f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 84ecf5bb-f207-4523-bb55-fb147ede0570] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:43 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-efc658b6-430e-4aca-9250-4f3d0107d81f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:43 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-efc658b6-430e-4aca-9250-4f3d0107d81f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:43 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-efc658b6-430e-4aca-9250-4f3d0107d81f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:43 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-efc658b6-430e-4aca-9250-4f3d0107d81f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:43 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-efc658b6-430e-4aca-9250-4f3d0107d81f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:43 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-efc658b6-430e-4aca-9250-4f3d0107d81f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:43 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-efc658b6-430e-4aca-9250-4f3d0107d81f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 84ecf5bb-f207-4523-bb55-fb147ede0570] Going to try to terminate instance {{(pid=61311) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:37:43 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-efc658b6-430e-4aca-9250-4f3d0107d81f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570" status: 204 len: 0 microversion: 2.1 time: 0.113584 Apr 18 14:37:43 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 101/306] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:37:43 2023] DELETE /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:37:43 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-8da6e952-fc17-4e99-a737-7e8e9fbbd54a tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:43 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-8da6e952-fc17-4e99-a737-7e8e9fbbd54a tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 84ecf5bb-f207-4523-bb55-fb147ede0570] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:43 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8da6e952-fc17-4e99-a737-7e8e9fbbd54a tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:43 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8da6e952-fc17-4e99-a737-7e8e9fbbd54a tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:43 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8da6e952-fc17-4e99-a737-7e8e9fbbd54a tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:43 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8da6e952-fc17-4e99-a737-7e8e9fbbd54a tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:43 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8da6e952-fc17-4e99-a737-7e8e9fbbd54a tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:43 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8da6e952-fc17-4e99-a737-7e8e9fbbd54a tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:43 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-8da6e952-fc17-4e99-a737-7e8e9fbbd54a tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd536529724c41980d5f2fddd8c71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38cf2921e9c49b98933eb439c2ea431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:37:43 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-8da6e952-fc17-4e99-a737-7e8e9fbbd54a tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570" status: 200 len: 1669 microversion: 2.1 time: 0.260999 Apr 18 14:37:43 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 103/307] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:37:43 2023] GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570 => generated 1669 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 14:37:44 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-d2c4ae13-bcc0-4b90-9694-2fa88c3d58be req-01291ec3-3514-4400-918c-7b004157d9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ecf5bb-f207-4523-bb55-fb147ede0570", "name": "network-vif-unplugged", "status": "completed", "tag": "1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71"}, {"server_uuid": "84ecf5bb-f207-4523-bb55-fb147ede0570", "name": "network-vif-plugged", "status": "completed", "tag": "1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:37:44 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-d2c4ae13-bcc0-4b90-9694-2fa88c3d58be req-01291ec3-3514-4400-918c-7b004157d9f4 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:44 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-d2c4ae13-bcc0-4b90-9694-2fa88c3d58be req-01291ec3-3514-4400-918c-7b004157d9f4 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:44 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-d2c4ae13-bcc0-4b90-9694-2fa88c3d58be req-01291ec3-3514-4400-918c-7b004157d9f4 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:44 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-d2c4ae13-bcc0-4b90-9694-2fa88c3d58be req-01291ec3-3514-4400-918c-7b004157d9f4 service nova] Creating event network-vif-unplugged:1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71 for instance 84ecf5bb-f207-4523-bb55-fb147ede0570 on user Apr 18 14:37:44 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-d2c4ae13-bcc0-4b90-9694-2fa88c3d58be req-01291ec3-3514-4400-918c-7b004157d9f4 service nova] Creating event network-vif-plugged:1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71 for instance 84ecf5bb-f207-4523-bb55-fb147ede0570 on user Apr 18 14:37:44 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-d2c4ae13-bcc0-4b90-9694-2fa88c3d58be req-01291ec3-3514-4400-918c-7b004157d9f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030477 Apr 18 14:37:44 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 104/308] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:37:44 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:45 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-40e57c4e-b9b5-4a27-8ebd-6a4b005dbb1b req-552f4827-5dab-4d16-8d71-8c6dcd124889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ecf5bb-f207-4523-bb55-fb147ede0570", "name": "network-vif-deleted", "tag": "1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:37:45 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-40e57c4e-b9b5-4a27-8ebd-6a4b005dbb1b req-552f4827-5dab-4d16-8d71-8c6dcd124889 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:45 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-40e57c4e-b9b5-4a27-8ebd-6a4b005dbb1b req-552f4827-5dab-4d16-8d71-8c6dcd124889 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:45 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-40e57c4e-b9b5-4a27-8ebd-6a4b005dbb1b req-552f4827-5dab-4d16-8d71-8c6dcd124889 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:45 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-40e57c4e-b9b5-4a27-8ebd-6a4b005dbb1b req-552f4827-5dab-4d16-8d71-8c6dcd124889 service nova] Creating event network-vif-deleted:1cd1d4a7-ab15-4cc6-873a-83d6cde5ab71 for instance 84ecf5bb-f207-4523-bb55-fb147ede0570 on user Apr 18 14:37:45 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-40e57c4e-b9b5-4a27-8ebd-6a4b005dbb1b req-552f4827-5dab-4d16-8d71-8c6dcd124889 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033214 Apr 18 14:37:45 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 102/309] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:37:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-5d82ed7a-03b0-44d3-bf81-3438bbc0f864 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-5d82ed7a-03b0-44d3-bf81-3438bbc0f864 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: 1b25948f-1d8c-4058-b3ed-8dca864de019] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-5d82ed7a-03b0-44d3-bf81-3438bbc0f864 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-5d82ed7a-03b0-44d3-bf81-3438bbc0f864 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-5d82ed7a-03b0-44d3-bf81-3438bbc0f864 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-5d82ed7a-03b0-44d3-bf81-3438bbc0f864 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-5d82ed7a-03b0-44d3-bf81-3438bbc0f864 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-5d82ed7a-03b0-44d3-bf81-3438bbc0f864 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:50 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-5d82ed7a-03b0-44d3-bf81-3438bbc0f864 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] HTTP exception thrown: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-5d82ed7a-03b0-44d3-bf81-3438bbc0f864 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Request method failure captured: Apr 18 14:37:50 user devstack@n-api.service[61310]: request: DELETE /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019 HTTP/1.1 Apr 18 14:37:50 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:37:50 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:37:50 user devstack@n-api.service[61310]: Connection: close Apr 18 14:37:50 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:37:50 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:37:50 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:37:50 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:37:50 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqk01BOvVmbB2Ieo9eow9OsPXEa8j7QHz28HDii3x0B-sbBWerJe8bp-cIIrFClR5xWbKKrDLUPVmvc18B44p7hZxOj_wUba2spIm_6jNZqszskDdyKBp0g7AflgpDk4aezgROrfADu6LT_Z2GK_PlFoUnNpbMuYdApcgMNnio5a8iI Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Project-Id: 3312c2b6e41142799cb66dd1377558d8 Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Project-Name: tempest-ServersNegativeTestJSON-1865061463 Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3312c2b6e41142799cb66dd1377558d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3312c2b6e41142799cb66dd1377558d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3312c2b6e41142799cb66dd1377558d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Tenant: tempest-ServersNegativeTestJSON-1865061463 Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Tenant-Id: 3312c2b6e41142799cb66dd1377558d8 Apr 18 14:37:50 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1865061463 Apr 18 14:37:50 user devstack@n-api.service[61310]: X-User: tempest-ServersNegativeTestJSON-1865061463-project-member Apr 18 14:37:50 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:37:50 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:37:50 user devstack@n-api.service[61310]: X-User-Id: b209357fca7f40c0b52507a285e054e3 Apr 18 14:37:50 user devstack@n-api.service[61310]: X-User-Name: tempest-ServersNegativeTestJSON-1865061463-project-member Apr 18 14:37:50 user devstack@n-api.service[61310]: method: > Apr 18 14:37:50 user devstack@n-api.service[61310]: exception: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:37:50 user devstack@n-api.service[61310]: action_args: {'id': '1b25948f-1d8c-4058-b3ed-8dca864de019'} Apr 18 14:37:50 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:37:50 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-5d82ed7a-03b0-44d3-bf81-3438bbc0f864 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Returning 404 to user: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:37:50 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-5d82ed7a-03b0-44d3-bf81-3438bbc0f864 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019" status: 404 len: 111 microversion: 2.1 time: 0.032868 Apr 18 14:37:50 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 104/310] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:37:50 2023] DELETE /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-4babb703-3b6d-42a2-aa02-32b75ef49603 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-4babb703-3b6d-42a2-aa02-32b75ef49603 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: 1b25948f-1d8c-4058-b3ed-8dca864de019] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4babb703-3b6d-42a2-aa02-32b75ef49603 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4babb703-3b6d-42a2-aa02-32b75ef49603 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4babb703-3b6d-42a2-aa02-32b75ef49603 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4babb703-3b6d-42a2-aa02-32b75ef49603 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4babb703-3b6d-42a2-aa02-32b75ef49603 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4babb703-3b6d-42a2-aa02-32b75ef49603 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:50 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-4babb703-3b6d-42a2-aa02-32b75ef49603 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] HTTP exception thrown: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-4babb703-3b6d-42a2-aa02-32b75ef49603 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Request method failure captured: Apr 18 14:37:50 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019 HTTP/1.1 Apr 18 14:37:50 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:37:50 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:37:50 user devstack@n-api.service[61309]: Connection: close Apr 18 14:37:50 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:37:50 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:37:50 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:37:50 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:37:50 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqk01BOvVmbB2Ieo9eow9OsPXEa8j7QHz28HDii3x0B-sbBWerJe8bp-cIIrFClR5xWbKKrDLUPVmvc18B44p7hZxOj_wUba2spIm_6jNZqszskDdyKBp0g7AflgpDk4aezgROrfADu6LT_Z2GK_PlFoUnNpbMuYdApcgMNnio5a8iI Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Project-Id: 3312c2b6e41142799cb66dd1377558d8 Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Project-Name: tempest-ServersNegativeTestJSON-1865061463 Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3312c2b6e41142799cb66dd1377558d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3312c2b6e41142799cb66dd1377558d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3312c2b6e41142799cb66dd1377558d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Tenant: tempest-ServersNegativeTestJSON-1865061463 Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Tenant-Id: 3312c2b6e41142799cb66dd1377558d8 Apr 18 14:37:50 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1865061463 Apr 18 14:37:50 user devstack@n-api.service[61309]: X-User: tempest-ServersNegativeTestJSON-1865061463-project-member Apr 18 14:37:50 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:37:50 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:37:50 user devstack@n-api.service[61309]: X-User-Id: b209357fca7f40c0b52507a285e054e3 Apr 18 14:37:50 user devstack@n-api.service[61309]: X-User-Name: tempest-ServersNegativeTestJSON-1865061463-project-member Apr 18 14:37:50 user devstack@n-api.service[61309]: method: > Apr 18 14:37:50 user devstack@n-api.service[61309]: exception: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:37:50 user devstack@n-api.service[61309]: action_args: {'id': '1b25948f-1d8c-4058-b3ed-8dca864de019'} Apr 18 14:37:50 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. Apr 18 14:37:50 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-4babb703-3b6d-42a2-aa02-32b75ef49603 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Returning 404 to user: Instance 1b25948f-1d8c-4058-b3ed-8dca864de019 could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:37:50 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-4babb703-3b6d-42a2-aa02-32b75ef49603 tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019" status: 404 len: 111 microversion: 2.1 time: 0.032100 Apr 18 14:37:50 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 105/311] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:37:50 2023] GET /compute/v2.1/servers/1b25948f-1d8c-4058-b3ed-8dca864de019 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:37:50 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-39f671f6-6d70-483b-b787-47f6c61232ad tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:50 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-39f671f6-6d70-483b-b787-47f6c61232ad tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: e5323297-c840-4fd6-9a76-727ed36de870] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-39f671f6-6d70-483b-b787-47f6c61232ad tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-39f671f6-6d70-483b-b787-47f6c61232ad tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-39f671f6-6d70-483b-b787-47f6c61232ad tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-39f671f6-6d70-483b-b787-47f6c61232ad tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-39f671f6-6d70-483b-b787-47f6c61232ad tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-39f671f6-6d70-483b-b787-47f6c61232ad tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:50 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-39f671f6-6d70-483b-b787-47f6c61232ad tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: e5323297-c840-4fd6-9a76-727ed36de870] Going to try to terminate instance {{(pid=61311) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:37:50 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-39f671f6-6d70-483b-b787-47f6c61232ad tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870" status: 204 len: 0 microversion: 2.1 time: 0.107205 Apr 18 14:37:50 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 103/312] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:37:50 2023] DELETE /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-b1c0ce46-d17f-4ce7-9a52-86d411afea9d tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-b1c0ce46-d17f-4ce7-9a52-86d411afea9d tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: e5323297-c840-4fd6-9a76-727ed36de870] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-b1c0ce46-d17f-4ce7-9a52-86d411afea9d tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-b1c0ce46-d17f-4ce7-9a52-86d411afea9d tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-b1c0ce46-d17f-4ce7-9a52-86d411afea9d tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-b1c0ce46-d17f-4ce7-9a52-86d411afea9d tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-b1c0ce46-d17f-4ce7-9a52-86d411afea9d tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-b1c0ce46-d17f-4ce7-9a52-86d411afea9d tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-628f0e7b-7cbb-460d-8353-2dce255af5c8 req-2aafe5a7-597f-4bd5-ad44-2596be27dcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5323297-c840-4fd6-9a76-727ed36de870", "name": "network-vif-unplugged", "status": "completed", "tag": "1c41c5ca-21a5-4ea1-9a38-7c78341ea267"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-628f0e7b-7cbb-460d-8353-2dce255af5c8 req-2aafe5a7-597f-4bd5-ad44-2596be27dcf6 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-628f0e7b-7cbb-460d-8353-2dce255af5c8 req-2aafe5a7-597f-4bd5-ad44-2596be27dcf6 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:50 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-628f0e7b-7cbb-460d-8353-2dce255af5c8 req-2aafe5a7-597f-4bd5-ad44-2596be27dcf6 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:50 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-628f0e7b-7cbb-460d-8353-2dce255af5c8 req-2aafe5a7-597f-4bd5-ad44-2596be27dcf6 service nova] Creating event network-vif-unplugged:1c41c5ca-21a5-4ea1-9a38-7c78341ea267 for instance e5323297-c840-4fd6-9a76-727ed36de870 on user Apr 18 14:37:50 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-b1c0ce46-d17f-4ce7-9a52-86d411afea9d tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b209357fca7f40c0b52507a285e054e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3312c2b6e41142799cb66dd1377558d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:37:50 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-628f0e7b-7cbb-460d-8353-2dce255af5c8 req-2aafe5a7-597f-4bd5-ad44-2596be27dcf6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033055 Apr 18 14:37:50 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 106/313] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:37:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:50 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-b1c0ce46-d17f-4ce7-9a52-86d411afea9d tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870" status: 200 len: 1499 microversion: 2.1 time: 0.287383 Apr 18 14:37:50 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 105/314] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:37:50 2023] GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870 => generated 1499 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:37:51 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-303f26e1-125b-44e7-b516-c6046212de76 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:51 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-303f26e1-125b-44e7-b516-c6046212de76 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] [instance: 6795fad9-3f0a-430b-8319-a3c6025122c3] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:37:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-303f26e1-125b-44e7-b516-c6046212de76 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-303f26e1-125b-44e7-b516-c6046212de76 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-303f26e1-125b-44e7-b516-c6046212de76 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-303f26e1-125b-44e7-b516-c6046212de76 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-303f26e1-125b-44e7-b516-c6046212de76 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:51 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-303f26e1-125b-44e7-b516-c6046212de76 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:51 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-303f26e1-125b-44e7-b516-c6046212de76 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] HTTP exception thrown: Instance 6795fad9-3f0a-430b-8319-a3c6025122c3 could not be found. Apr 18 14:37:51 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-303f26e1-125b-44e7-b516-c6046212de76 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Request method failure captured: Apr 18 14:37:51 user devstack@n-api.service[61311]: request: GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3 HTTP/1.1 Apr 18 14:37:51 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:37:51 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:37:51 user devstack@n-api.service[61311]: Connection: close Apr 18 14:37:51 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:37:51 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:37:51 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:37:51 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:37:51 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqopjdquko_w6xjjJHZaIXJj1DIXpnGNTKw62kG13vtBq27Fdcz5pdUQitMpbDxzRhZ99iOV6fityHPPMNBmUsPk4LglpxibRvIT-c_CC_P_53D4QuWxxwqFEBcnkZsjRde-kQY0YsQTpgttExJKFjZdQrZYYbwFdBwzhFhXf-Ft9CQ Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Project-Id: e5667da319fd405e96f277368203a72b Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Project-Name: tempest-ServerStableDeviceRescueTest-52897700 Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e5667da319fd405e96f277368203a72b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e5667da319fd405e96f277368203a72b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e5667da319fd405e96f277368203a72b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Tenant: tempest-ServerStableDeviceRescueTest-52897700 Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Tenant-Id: e5667da319fd405e96f277368203a72b Apr 18 14:37:51 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-52897700 Apr 18 14:37:51 user devstack@n-api.service[61311]: X-User: tempest-ServerStableDeviceRescueTest-52897700-project-member Apr 18 14:37:51 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:37:51 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:37:51 user devstack@n-api.service[61311]: X-User-Id: 53a60dd2a8ca42b391d4584accb60b4f Apr 18 14:37:51 user devstack@n-api.service[61311]: X-User-Name: tempest-ServerStableDeviceRescueTest-52897700-project-member Apr 18 14:37:51 user devstack@n-api.service[61311]: method: > Apr 18 14:37:51 user devstack@n-api.service[61311]: exception: Instance 6795fad9-3f0a-430b-8319-a3c6025122c3 could not be found. Apr 18 14:37:51 user devstack@n-api.service[61311]: action_args: {'id': '6795fad9-3f0a-430b-8319-a3c6025122c3'} Apr 18 14:37:51 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6795fad9-3f0a-430b-8319-a3c6025122c3 could not be found. Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6795fad9-3f0a-430b-8319-a3c6025122c3 could not be found. Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6795fad9-3f0a-430b-8319-a3c6025122c3 could not be found. Apr 18 14:37:51 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:37:51 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-303f26e1-125b-44e7-b516-c6046212de76 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Returning 404 to user: Instance 6795fad9-3f0a-430b-8319-a3c6025122c3 could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:37:51 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-303f26e1-125b-44e7-b516-c6046212de76 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3" status: 404 len: 111 microversion: 2.1 time: 0.030947 Apr 18 14:37:51 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 104/315] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:37:51 2023] GET /compute/v2.1/servers/6795fad9-3f0a-430b-8319-a3c6025122c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:37:51 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-8bb5a90e-eb29-4f88-b9f7-5d5d07c096d7 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] Calling method '.version_select at 0x7f5cee9db760>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:37:51 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-8bb5a90e-eb29-4f88-b9f7-5d5d07c096d7 tempest-ServerStableDeviceRescueTest-52897700 tempest-ServerStableDeviceRescueTest-52897700-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010940465" status: 202 len: 0 microversion: 2.1 time: 0.025126 Apr 18 14:37:51 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 107/316] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 14:37:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010940465 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:37:51 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-f15eb852-9c26-4134-a95d-8405d541bebd req-49b84684-7bf6-4cd0-a329-9e1eccf2fe89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5323297-c840-4fd6-9a76-727ed36de870", "name": "network-vif-deleted", "tag": "1c41c5ca-21a5-4ea1-9a38-7c78341ea267"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:37:51 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-f15eb852-9c26-4134-a95d-8405d541bebd req-49b84684-7bf6-4cd0-a329-9e1eccf2fe89 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:51 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-f15eb852-9c26-4134-a95d-8405d541bebd req-49b84684-7bf6-4cd0-a329-9e1eccf2fe89 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:51 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-f15eb852-9c26-4134-a95d-8405d541bebd req-49b84684-7bf6-4cd0-a329-9e1eccf2fe89 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:51 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-f15eb852-9c26-4134-a95d-8405d541bebd req-49b84684-7bf6-4cd0-a329-9e1eccf2fe89 service nova] Creating event network-vif-deleted:1c41c5ca-21a5-4ea1-9a38-7c78341ea267 for instance e5323297-c840-4fd6-9a76-727ed36de870 on user Apr 18 14:37:51 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-f15eb852-9c26-4134-a95d-8405d541bebd req-49b84684-7bf6-4cd0-a329-9e1eccf2fe89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028104 Apr 18 14:37:51 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 106/317] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:37:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:37:52 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-acf04d09-1bec-4426-aee4-ba305e2a922a req-42124fcc-ffc8-4097-bd35-ff1e30f7d6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5323297-c840-4fd6-9a76-727ed36de870", "name": "network-vif-plugged", "status": "completed", "tag": "1c41c5ca-21a5-4ea1-9a38-7c78341ea267"}, {"server_uuid": "e5323297-c840-4fd6-9a76-727ed36de870", "name": "network-vif-plugged", "status": "completed", "tag": "1c41c5ca-21a5-4ea1-9a38-7c78341ea267"}, {"server_uuid": "e5323297-c840-4fd6-9a76-727ed36de870", "name": "network-vif-plugged", "status": "completed", "tag": "1c41c5ca-21a5-4ea1-9a38-7c78341ea267"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:37:52 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-acf04d09-1bec-4426-aee4-ba305e2a922a req-42124fcc-ffc8-4097-bd35-ff1e30f7d6a2 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:37:52 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-acf04d09-1bec-4426-aee4-ba305e2a922a req-42124fcc-ffc8-4097-bd35-ff1e30f7d6a2 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:37:52 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-acf04d09-1bec-4426-aee4-ba305e2a922a req-42124fcc-ffc8-4097-bd35-ff1e30f7d6a2 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:37:52 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-acf04d09-1bec-4426-aee4-ba305e2a922a req-42124fcc-ffc8-4097-bd35-ff1e30f7d6a2 service nova] Creating event network-vif-plugged:1c41c5ca-21a5-4ea1-9a38-7c78341ea267 for instance e5323297-c840-4fd6-9a76-727ed36de870 on user Apr 18 14:37:52 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-acf04d09-1bec-4426-aee4-ba305e2a922a req-42124fcc-ffc8-4097-bd35-ff1e30f7d6a2 service nova] Creating event network-vif-plugged:1c41c5ca-21a5-4ea1-9a38-7c78341ea267 for instance e5323297-c840-4fd6-9a76-727ed36de870 on user Apr 18 14:37:52 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-acf04d09-1bec-4426-aee4-ba305e2a922a req-42124fcc-ffc8-4097-bd35-ff1e30f7d6a2 service nova] Creating event network-vif-plugged:1c41c5ca-21a5-4ea1-9a38-7c78341ea267 for instance e5323297-c840-4fd6-9a76-727ed36de870 on user Apr 18 14:37:52 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-acf04d09-1bec-4426-aee4-ba305e2a922a req-42124fcc-ffc8-4097-bd35-ff1e30f7d6a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.054267 Apr 18 14:37:52 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 105/318] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:37:52 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:38:02 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=10 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:02 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:02 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-fa97aa01-36d7-4853-a08d-8b019d6a4751 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Action: 'create', calling method: .version_select at 0x7f5cee9db520>, body: {"keypair": {"name": "tempest-keypair-755706090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfq5Z58u1uSYREY9SKWqKeMpnuTkMbMIBy5CF2rVzPyzYZIrrR6t3lPJnMnil7ZaKjyAyDhgRan3Nf21kceRl/K6c1olxV0dH0qUYjnFgqLLnBE72IibaVMUmTWHWF0Dg=="}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:02 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-fa97aa01-36d7-4853-a08d-8b019d6a4751 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Getting quotas for project 3549c53be65e4fc2a2bb124109319ca2. Resources: {'key_pairs'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:38:02 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-fa97aa01-36d7-4853-a08d-8b019d6a4751 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Getting quotas for user 8b4ce9342145403c9ba6a9871fbf490e and project 3549c53be65e4fc2a2bb124109319ca2. Resources: {'key_pairs'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:38:02 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-fa97aa01-36d7-4853-a08d-8b019d6a4751 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.153108 Apr 18 14:38:02 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 108/319] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 14:38:02 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 14:38:03 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=10 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:03 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=18 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:03 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-768362337", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "624f60ce-989c-4401-bbed-ba6d9b82f01c"}], "security_groups": [{"name": "tempest-securitygroup--655410088"}], "key_name": "tempest-keypair-755706090", "user_data": "}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG nova.network.neutron [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] validate_networks() for [('624f60ce-989c-4401-bbed-ba6d9b82f01c', None, None, None, None, None)] {{(pid=61310) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Flavor limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Image limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Flavor pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Image pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Getting quotas for project 3549c53be65e4fc2a2bb124109319ca2. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Getting quotas for user 8b4ce9342145403c9ba6a9871fbf490e and project 3549c53be65e4fc2a2bb124109319ca2. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Going to run 1 instances... {{(pid=61310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:38:04 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: b3543651-513e-446d-a15d-563bc0c76e5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:38:04 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-039aeba6-37aa-4577-8aa9-2f453d0fecdd tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.827873 Apr 18 14:38:04 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 107/320] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 14:38:03 2023] POST /compute/v2.1/servers => generated 399 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 14:38:04 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:04 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:04 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-6648774b-9771-485c-bffa-0542044c77b3 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:38:04 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-6648774b-9771-485c-bffa-0542044c77b3 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: b3543651-513e-446d-a15d-563bc0c76e5d] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:38:04 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-6648774b-9771-485c-bffa-0542044c77b3 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:38:04 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-6648774b-9771-485c-bffa-0542044c77b3 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:38:04 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-6648774b-9771-485c-bffa-0542044c77b3 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:38:04 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-6648774b-9771-485c-bffa-0542044c77b3 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d" status: 200 len: 1274 microversion: 2.20 time: 0.090850 Apr 18 14:38:04 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 106/321] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:38:04 2023] GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:38:07 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-edd4ab51-6702-43aa-90e5-58c73d344b82 req-b974a4fb-94d4-42a7-995e-652851605041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3543651-513e-446d-a15d-563bc0c76e5d", "tag": "2278d6f2-24ff-4870-9be5-a5fae51c37b1"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-edd4ab51-6702-43aa-90e5-58c73d344b82 req-b974a4fb-94d4-42a7-995e-652851605041 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-edd4ab51-6702-43aa-90e5-58c73d344b82 req-b974a4fb-94d4-42a7-995e-652851605041 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-edd4ab51-6702-43aa-90e5-58c73d344b82 req-b974a4fb-94d4-42a7-995e-652851605041 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:07 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-edd4ab51-6702-43aa-90e5-58c73d344b82 req-b974a4fb-94d4-42a7-995e-652851605041 service nova] Creating event network-changed:2278d6f2-24ff-4870-9be5-a5fae51c37b1 for instance b3543651-513e-446d-a15d-563bc0c76e5d on user Apr 18 14:38:07 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-edd4ab51-6702-43aa-90e5-58c73d344b82 req-b974a4fb-94d4-42a7-995e-652851605041 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033928 Apr 18 14:38:07 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 109/322] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:38:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:38:09 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-d29f96d5-1b36-4891-adaf-6d4bdcb97194 req-f975f4d2-a31a-4998-9b5e-40ed7a0ccca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3543651-513e-446d-a15d-563bc0c76e5d", "name": "network-vif-plugged", "status": "completed", "tag": "2278d6f2-24ff-4870-9be5-a5fae51c37b1"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:09 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-d29f96d5-1b36-4891-adaf-6d4bdcb97194 req-f975f4d2-a31a-4998-9b5e-40ed7a0ccca3 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:09 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-d29f96d5-1b36-4891-adaf-6d4bdcb97194 req-f975f4d2-a31a-4998-9b5e-40ed7a0ccca3 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:09 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-d29f96d5-1b36-4891-adaf-6d4bdcb97194 req-f975f4d2-a31a-4998-9b5e-40ed7a0ccca3 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:09 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-d29f96d5-1b36-4891-adaf-6d4bdcb97194 req-f975f4d2-a31a-4998-9b5e-40ed7a0ccca3 service nova] Creating event network-vif-plugged:2278d6f2-24ff-4870-9be5-a5fae51c37b1 for instance b3543651-513e-446d-a15d-563bc0c76e5d on user Apr 18 14:38:09 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-d29f96d5-1b36-4891-adaf-6d4bdcb97194 req-f975f4d2-a31a-4998-9b5e-40ed7a0ccca3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037373 Apr 18 14:38:09 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 108/323] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:38:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:38:10 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-80cfe8d2-b76b-443f-a6be-40435a02d8e5 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:38:10 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-80cfe8d2-b76b-443f-a6be-40435a02d8e5 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] [instance: 08df03c8-06e2-487f-811b-32f1a244ab39] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:38:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-80cfe8d2-b76b-443f-a6be-40435a02d8e5 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-80cfe8d2-b76b-443f-a6be-40435a02d8e5 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-80cfe8d2-b76b-443f-a6be-40435a02d8e5 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-80cfe8d2-b76b-443f-a6be-40435a02d8e5 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-80cfe8d2-b76b-443f-a6be-40435a02d8e5 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-80cfe8d2-b76b-443f-a6be-40435a02d8e5 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:11 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-80cfe8d2-b76b-443f-a6be-40435a02d8e5 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] HTTP exception thrown: Instance 08df03c8-06e2-487f-811b-32f1a244ab39 could not be found. Apr 18 14:38:11 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-80cfe8d2-b76b-443f-a6be-40435a02d8e5 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Request method failure captured: Apr 18 14:38:11 user devstack@n-api.service[61311]: request: GET /compute/v2.1/servers/08df03c8-06e2-487f-811b-32f1a244ab39 HTTP/1.1 Apr 18 14:38:11 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:38:11 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:38:11 user devstack@n-api.service[61311]: Connection: close Apr 18 14:38:11 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:38:11 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:38:11 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:38:11 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:38:11 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqqvK5fZ62M6hcQsZnNNnkaX9ZxK1ISJFIY5gvmZ52nQqdPrshu1Ew-G8BnBQQSGB690qEHyZ3--9VOoq3kq6JDi3hhwV1KMCbIDPis8b5U-Avx20BAW-kpWFG77O4YF1jehe9rbkC1Q7BzM82BbVTVOrlmnLg-2L7ensSVmHN23o9A Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Project-Id: 7a59feb1aea84dbf8baeaa24872f23a5 Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Project-Name: tempest-DeleteServersTestJSON-1624717819 Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a59feb1aea84dbf8baeaa24872f23a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a59feb1aea84dbf8baeaa24872f23a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a59feb1aea84dbf8baeaa24872f23a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Tenant: tempest-DeleteServersTestJSON-1624717819 Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Tenant-Id: 7a59feb1aea84dbf8baeaa24872f23a5 Apr 18 14:38:11 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-DeleteServersTestJSON-1624717819 Apr 18 14:38:11 user devstack@n-api.service[61311]: X-User: tempest-DeleteServersTestJSON-1624717819-project-member Apr 18 14:38:11 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:38:11 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:38:11 user devstack@n-api.service[61311]: X-User-Id: 0953591cb5174b66a333e9740b50c32e Apr 18 14:38:11 user devstack@n-api.service[61311]: X-User-Name: tempest-DeleteServersTestJSON-1624717819-project-member Apr 18 14:38:11 user devstack@n-api.service[61311]: method: > Apr 18 14:38:11 user devstack@n-api.service[61311]: exception: Instance 08df03c8-06e2-487f-811b-32f1a244ab39 could not be found. Apr 18 14:38:11 user devstack@n-api.service[61311]: action_args: {'id': '08df03c8-06e2-487f-811b-32f1a244ab39'} Apr 18 14:38:11 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08df03c8-06e2-487f-811b-32f1a244ab39 could not be found. Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08df03c8-06e2-487f-811b-32f1a244ab39 could not be found. Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08df03c8-06e2-487f-811b-32f1a244ab39 could not be found. Apr 18 14:38:11 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:38:11 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-80cfe8d2-b76b-443f-a6be-40435a02d8e5 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] Returning 404 to user: Instance 08df03c8-06e2-487f-811b-32f1a244ab39 could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:38:11 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-80cfe8d2-b76b-443f-a6be-40435a02d8e5 tempest-DeleteServersTestJSON-1624717819 tempest-DeleteServersTestJSON-1624717819-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08df03c8-06e2-487f-811b-32f1a244ab39" status: 404 len: 111 microversion: 2.1 time: 0.034200 Apr 18 14:38:11 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 107/324] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:38:10 2023] GET /compute/v2.1/servers/08df03c8-06e2-487f-811b-32f1a244ab39 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:38:11 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-3902dea1-8f0f-4465-9216-0848b7eff9fc req-50fd1494-1156-4efe-babd-b286a41f6d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3543651-513e-446d-a15d-563bc0c76e5d", "name": "network-vif-plugged", "status": "completed", "tag": "2278d6f2-24ff-4870-9be5-a5fae51c37b1"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:11 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-3902dea1-8f0f-4465-9216-0848b7eff9fc req-50fd1494-1156-4efe-babd-b286a41f6d64 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:11 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-3902dea1-8f0f-4465-9216-0848b7eff9fc req-50fd1494-1156-4efe-babd-b286a41f6d64 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:11 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-3902dea1-8f0f-4465-9216-0848b7eff9fc req-50fd1494-1156-4efe-babd-b286a41f6d64 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:11 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-3902dea1-8f0f-4465-9216-0848b7eff9fc req-50fd1494-1156-4efe-babd-b286a41f6d64 service nova] Creating event network-vif-plugged:2278d6f2-24ff-4870-9be5-a5fae51c37b1 for instance b3543651-513e-446d-a15d-563bc0c76e5d on user Apr 18 14:38:11 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-3902dea1-8f0f-4465-9216-0848b7eff9fc req-50fd1494-1156-4efe-babd-b286a41f6d64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033107 Apr 18 14:38:11 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 110/325] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:38:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:38:15 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:15 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:15 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-904f9ac6-665d-412b-b242-d86bf894945a tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:38:15 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-904f9ac6-665d-412b-b242-d86bf894945a tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:38:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-904f9ac6-665d-412b-b242-d86bf894945a tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-904f9ac6-665d-412b-b242-d86bf894945a tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-904f9ac6-665d-412b-b242-d86bf894945a tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-904f9ac6-665d-412b-b242-d86bf894945a tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-904f9ac6-665d-412b-b242-d86bf894945a tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-904f9ac6-665d-412b-b242-d86bf894945a tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:15 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-904f9ac6-665d-412b-b242-d86bf894945a tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Going to try to terminate instance {{(pid=61310) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:38:15 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-904f9ac6-665d-412b-b242-d86bf894945a tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 204 len: 0 microversion: 2.1 time: 0.122008 Apr 18 14:38:15 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 109/326] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:38:15 2023] DELETE /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:38:15 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-9c576ad9-7fe1-4185-9d93-c85cb60f6b47 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:38:15 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-9c576ad9-7fe1-4185-9d93-c85cb60f6b47 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:38:15 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-9c576ad9-7fe1-4185-9d93-c85cb60f6b47 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-9c576ad9-7fe1-4185-9d93-c85cb60f6b47 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-9c576ad9-7fe1-4185-9d93-c85cb60f6b47 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-9c576ad9-7fe1-4185-9d93-c85cb60f6b47 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-9c576ad9-7fe1-4185-9d93-c85cb60f6b47 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-9c576ad9-7fe1-4185-9d93-c85cb60f6b47 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:15 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-9c576ad9-7fe1-4185-9d93-c85cb60f6b47 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614f7a3a8f3348df9d81f693e733905b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '279c1fea5cfc423b94ca756ebafb2515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:38:15 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-9c576ad9-7fe1-4185-9d93-c85cb60f6b47 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 200 len: 1662 microversion: 2.1 time: 0.397131 Apr 18 14:38:15 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 108/327] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:38:15 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 1662 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:38:15 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-14decf0d-7175-4837-a2f8-2a34eae67637 req-de17c126-a85f-4f12-8440-38116022d093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7c5ef9-09d6-477f-90a8-e6673f75b2cf", "name": "network-vif-unplugged", "status": "completed", "tag": "08bbe937-9331-46f0-a09e-06ca352d0e25"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:15 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=4 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:15 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-14decf0d-7175-4837-a2f8-2a34eae67637 req-de17c126-a85f-4f12-8440-38116022d093 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:15 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-14decf0d-7175-4837-a2f8-2a34eae67637 req-de17c126-a85f-4f12-8440-38116022d093 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:15 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-14decf0d-7175-4837-a2f8-2a34eae67637 req-de17c126-a85f-4f12-8440-38116022d093 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:15 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-14decf0d-7175-4837-a2f8-2a34eae67637 req-de17c126-a85f-4f12-8440-38116022d093 service nova] Creating event network-vif-unplugged:08bbe937-9331-46f0-a09e-06ca352d0e25 for instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf on user Apr 18 14:38:15 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-14decf0d-7175-4837-a2f8-2a34eae67637 req-de17c126-a85f-4f12-8440-38116022d093 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032913 Apr 18 14:38:15 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 111/328] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:38:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:38:17 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-875a2fae-9718-4672-b64d-e9e659ffdb09 req-151ddb2d-0982-498f-a2f6-897bff5e08d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7c5ef9-09d6-477f-90a8-e6673f75b2cf", "name": "network-vif-deleted", "tag": "08bbe937-9331-46f0-a09e-06ca352d0e25"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:17 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-875a2fae-9718-4672-b64d-e9e659ffdb09 req-151ddb2d-0982-498f-a2f6-897bff5e08d0 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:17 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-875a2fae-9718-4672-b64d-e9e659ffdb09 req-151ddb2d-0982-498f-a2f6-897bff5e08d0 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:17 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-875a2fae-9718-4672-b64d-e9e659ffdb09 req-151ddb2d-0982-498f-a2f6-897bff5e08d0 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:17 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-875a2fae-9718-4672-b64d-e9e659ffdb09 req-151ddb2d-0982-498f-a2f6-897bff5e08d0 service nova] Creating event network-vif-deleted:08bbe937-9331-46f0-a09e-06ca352d0e25 for instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf on user Apr 18 14:38:17 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-875a2fae-9718-4672-b64d-e9e659ffdb09 req-151ddb2d-0982-498f-a2f6-897bff5e08d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029765 Apr 18 14:38:17 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 110/329] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:38:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:38:17 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-08720653-e943-4f7a-8ded-fb8a5c138b50 req-fa95aeae-0037-4d58-899a-33e2ccf89f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7c5ef9-09d6-477f-90a8-e6673f75b2cf", "name": "network-vif-plugged", "status": "completed", "tag": "08bbe937-9331-46f0-a09e-06ca352d0e25"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:17 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-08720653-e943-4f7a-8ded-fb8a5c138b50 req-fa95aeae-0037-4d58-899a-33e2ccf89f0c service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:17 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-08720653-e943-4f7a-8ded-fb8a5c138b50 req-fa95aeae-0037-4d58-899a-33e2ccf89f0c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:17 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-08720653-e943-4f7a-8ded-fb8a5c138b50 req-fa95aeae-0037-4d58-899a-33e2ccf89f0c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:17 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-08720653-e943-4f7a-8ded-fb8a5c138b50 req-fa95aeae-0037-4d58-899a-33e2ccf89f0c service nova] Creating event network-vif-plugged:08bbe937-9331-46f0-a09e-06ca352d0e25 for instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf on user Apr 18 14:38:17 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-08720653-e943-4f7a-8ded-fb8a5c138b50 req-fa95aeae-0037-4d58-899a-33e2ccf89f0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033104 Apr 18 14:38:17 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 109/330] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:38:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:38:33 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:33 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:33 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-5cf269c0-6271-4326-811f-aecf5f3724ab tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:38:33 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-5cf269c0-6271-4326-811f-aecf5f3724ab tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 84ecf5bb-f207-4523-bb55-fb147ede0570] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:38:33 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-5cf269c0-6271-4326-811f-aecf5f3724ab tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:33 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-5cf269c0-6271-4326-811f-aecf5f3724ab tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:33 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-5cf269c0-6271-4326-811f-aecf5f3724ab tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:33 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-5cf269c0-6271-4326-811f-aecf5f3724ab tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:33 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-5cf269c0-6271-4326-811f-aecf5f3724ab tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:33 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-5cf269c0-6271-4326-811f-aecf5f3724ab tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:33 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-5cf269c0-6271-4326-811f-aecf5f3724ab tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] HTTP exception thrown: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:38:33 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-5cf269c0-6271-4326-811f-aecf5f3724ab tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Request method failure captured: Apr 18 14:38:33 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570 HTTP/1.1 Apr 18 14:38:33 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:38:33 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:38:33 user devstack@n-api.service[61309]: Connection: close Apr 18 14:38:33 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:38:33 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:38:33 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:38:33 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:38:33 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqrDabR2U-1ioZsog1d_Oe7stjemJyN965_3QF6lSyU5B3aX0TjwgV2ScEQsf8XtbOQxLYBn1q1tQEMntGIoyvVq5cW3kqQZHF8J8pWejXnqQQvbKTw-fm6UUe-u_HRbu6moOhNBxxZ9yz3p89jNLYmODyaAAvgUGYugBI5gCAN3RRc Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Project-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Project-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Tenant: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Tenant-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:38:33 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:38:33 user devstack@n-api.service[61309]: X-User: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:38:33 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:38:33 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:38:33 user devstack@n-api.service[61309]: X-User-Id: 43dd536529724c41980d5f2fddd8c71d Apr 18 14:38:33 user devstack@n-api.service[61309]: X-User-Name: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:38:33 user devstack@n-api.service[61309]: method: > Apr 18 14:38:33 user devstack@n-api.service[61309]: exception: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:38:33 user devstack@n-api.service[61309]: action_args: {'id': '84ecf5bb-f207-4523-bb55-fb147ede0570'} Apr 18 14:38:33 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:38:33 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:38:33 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-5cf269c0-6271-4326-811f-aecf5f3724ab tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Returning 404 to user: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:38:33 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-5cf269c0-6271-4326-811f-aecf5f3724ab tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570" status: 404 len: 111 microversion: 2.1 time: 0.039206 Apr 18 14:38:33 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 112/331] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:38:33 2023] GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:38:33 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:33 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:33 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-749bfef8-4f19-4339-9851-0910f85cab7a tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '.version_select at 0x7f5ceeafa8c0>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:38:33 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-749bfef8-4f19-4339-9851-0910f85cab7a tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-136376707" status: 202 len: 0 microversion: 2.1 time: 0.027345 Apr 18 14:38:33 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 111/332] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 14:38:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-136376707 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:38:34 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=10 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:34 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=10 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:34 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-999a6bad-16f8-4a6c-abd2-3f33b12e2cb6 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Action: 'create', calling method: .version_select at 0x7f5cee94c9d0>, body: {"keypair": {"name": "tempest-keypair-50073693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+LhzceJo0ZGKpdlufD2xPZSUw8oFwuTliNnK7qZhva8yOtYOFWJMFUGkYlkBB4GfwIFXjhsBSfQryQZ6O/MfuOw5s2Gync1Q5qTsTbyWJ0Uyh76Jw5aBS1qcHwu9XCuw=="}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:34 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-999a6bad-16f8-4a6c-abd2-3f33b12e2cb6 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Getting quotas for project e38cf2921e9c49b98933eb439c2ea431. Resources: {'key_pairs'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:38:34 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-999a6bad-16f8-4a6c-abd2-3f33b12e2cb6 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Getting quotas for user 43dd536529724c41980d5f2fddd8c71d and project e38cf2921e9c49b98933eb439c2ea431. Resources: {'key_pairs'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:38:34 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-999a6bad-16f8-4a6c-abd2-3f33b12e2cb6 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.080089 Apr 18 14:38:34 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 110/333] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:38:34 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:38:36 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1810225734", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "241eb4cb-7a63-47fa-873a-79cdcab7a582"}], "security_groups": [{"name": "tempest-securitygroup--538510966"}], "key_name": "tempest-keypair-50073693", "user_data": "}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:36 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] validate_networks() for [('241eb4cb-7a63-47fa-873a-79cdcab7a582', None, None, None, None, None)] {{(pid=61309) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Flavor limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Image limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Flavor pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Image pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Getting quotas for project e38cf2921e9c49b98933eb439c2ea431. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Getting quotas for user 43dd536529724c41980d5f2fddd8c71d and project e38cf2921e9c49b98933eb439c2ea431. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Going to run 1 instances... {{(pid=61309) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:38:37 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61309) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:38:37 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-d8c7b2fe-3ca1-4641-801d-82c093bca102 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.740740 Apr 18 14:38:37 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 113/334] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:38:36 2023] POST /compute/v2.1/servers => generated 399 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:38:37 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-862325db-922c-4dd8-b584-59776cfb0523 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:38:37 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-862325db-922c-4dd8-b584-59776cfb0523 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:38:37 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-862325db-922c-4dd8-b584-59776cfb0523 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd536529724c41980d5f2fddd8c71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38cf2921e9c49b98933eb439c2ea431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:38:37 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-862325db-922c-4dd8-b584-59776cfb0523 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1" status: 200 len: 1234 microversion: 2.1 time: 0.069980 Apr 18 14:38:37 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 112/335] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:38:37 2023] GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 => generated 1234 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:38:39 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-5d76e2de-d49f-4f7a-a260-70e983caa002 req-f8b1e9e1-4ebc-48ed-86f9-e8732be637f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1", "tag": "0340e0f7-d93d-41f2-9047-0d917af7db1c"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:39 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-5d76e2de-d49f-4f7a-a260-70e983caa002 req-f8b1e9e1-4ebc-48ed-86f9-e8732be637f7 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:39 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-5d76e2de-d49f-4f7a-a260-70e983caa002 req-f8b1e9e1-4ebc-48ed-86f9-e8732be637f7 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:39 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-5d76e2de-d49f-4f7a-a260-70e983caa002 req-f8b1e9e1-4ebc-48ed-86f9-e8732be637f7 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:39 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-5d76e2de-d49f-4f7a-a260-70e983caa002 req-f8b1e9e1-4ebc-48ed-86f9-e8732be637f7 service nova] Creating event network-changed:0340e0f7-d93d-41f2-9047-0d917af7db1c for instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 on user Apr 18 14:38:39 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-5d76e2de-d49f-4f7a-a260-70e983caa002 req-f8b1e9e1-4ebc-48ed-86f9-e8732be637f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048159 Apr 18 14:38:39 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 111/336] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:38:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:38:40 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-233e2ceb-8219-488e-93f3-1eb478a378db tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:38:40 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-233e2ceb-8219-488e-93f3-1eb478a378db tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] [instance: e5323297-c840-4fd6-9a76-727ed36de870] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:38:40 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-233e2ceb-8219-488e-93f3-1eb478a378db tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:40 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-233e2ceb-8219-488e-93f3-1eb478a378db tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:40 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-233e2ceb-8219-488e-93f3-1eb478a378db tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:40 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-233e2ceb-8219-488e-93f3-1eb478a378db tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:40 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-233e2ceb-8219-488e-93f3-1eb478a378db tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:40 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-233e2ceb-8219-488e-93f3-1eb478a378db tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:40 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-233e2ceb-8219-488e-93f3-1eb478a378db tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] HTTP exception thrown: Instance e5323297-c840-4fd6-9a76-727ed36de870 could not be found. Apr 18 14:38:40 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-233e2ceb-8219-488e-93f3-1eb478a378db tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Request method failure captured: Apr 18 14:38:40 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870 HTTP/1.1 Apr 18 14:38:40 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:38:40 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:38:40 user devstack@n-api.service[61309]: Connection: close Apr 18 14:38:40 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:38:40 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:38:40 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:38:40 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:38:40 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqk01BOvVmbB2Ieo9eow9OsPXEa8j7QHz28HDii3x0B-sbBWerJe8bp-cIIrFClR5xWbKKrDLUPVmvc18B44p7hZxOj_wUba2spIm_6jNZqszskDdyKBp0g7AflgpDk4aezgROrfADu6LT_Z2GK_PlFoUnNpbMuYdApcgMNnio5a8iI Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Project-Id: 3312c2b6e41142799cb66dd1377558d8 Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Project-Name: tempest-ServersNegativeTestJSON-1865061463 Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3312c2b6e41142799cb66dd1377558d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3312c2b6e41142799cb66dd1377558d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3312c2b6e41142799cb66dd1377558d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Tenant: tempest-ServersNegativeTestJSON-1865061463 Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Tenant-Id: 3312c2b6e41142799cb66dd1377558d8 Apr 18 14:38:40 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1865061463 Apr 18 14:38:40 user devstack@n-api.service[61309]: X-User: tempest-ServersNegativeTestJSON-1865061463-project-member Apr 18 14:38:40 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:38:40 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:38:40 user devstack@n-api.service[61309]: X-User-Id: b209357fca7f40c0b52507a285e054e3 Apr 18 14:38:40 user devstack@n-api.service[61309]: X-User-Name: tempest-ServersNegativeTestJSON-1865061463-project-member Apr 18 14:38:40 user devstack@n-api.service[61309]: method: > Apr 18 14:38:40 user devstack@n-api.service[61309]: exception: Instance e5323297-c840-4fd6-9a76-727ed36de870 could not be found. Apr 18 14:38:40 user devstack@n-api.service[61309]: action_args: {'id': 'e5323297-c840-4fd6-9a76-727ed36de870'} Apr 18 14:38:40 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5323297-c840-4fd6-9a76-727ed36de870 could not be found. Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5323297-c840-4fd6-9a76-727ed36de870 could not be found. Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5323297-c840-4fd6-9a76-727ed36de870 could not be found. Apr 18 14:38:40 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:38:40 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-233e2ceb-8219-488e-93f3-1eb478a378db tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] Returning 404 to user: Instance e5323297-c840-4fd6-9a76-727ed36de870 could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:38:40 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-233e2ceb-8219-488e-93f3-1eb478a378db tempest-ServersNegativeTestJSON-1865061463 tempest-ServersNegativeTestJSON-1865061463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870" status: 404 len: 111 microversion: 2.1 time: 0.037871 Apr 18 14:38:40 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 114/337] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:38:40 2023] GET /compute/v2.1/servers/e5323297-c840-4fd6-9a76-727ed36de870 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:38:41 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-e3cab0f4-cd82-41cf-8ec2-fb60f1bb6782 req-086faa9f-b965-4286-9a00-f1c0092a8900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1", "name": "network-vif-plugged", "status": "completed", "tag": "0340e0f7-d93d-41f2-9047-0d917af7db1c"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:41 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-e3cab0f4-cd82-41cf-8ec2-fb60f1bb6782 req-086faa9f-b965-4286-9a00-f1c0092a8900 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:41 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-e3cab0f4-cd82-41cf-8ec2-fb60f1bb6782 req-086faa9f-b965-4286-9a00-f1c0092a8900 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:41 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-e3cab0f4-cd82-41cf-8ec2-fb60f1bb6782 req-086faa9f-b965-4286-9a00-f1c0092a8900 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:41 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-e3cab0f4-cd82-41cf-8ec2-fb60f1bb6782 req-086faa9f-b965-4286-9a00-f1c0092a8900 service nova] Creating event network-vif-plugged:0340e0f7-d93d-41f2-9047-0d917af7db1c for instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 on user Apr 18 14:38:41 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-e3cab0f4-cd82-41cf-8ec2-fb60f1bb6782 req-086faa9f-b965-4286-9a00-f1c0092a8900 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030771 Apr 18 14:38:41 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 113/338] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:38:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:38:43 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-75cc1ac0-72ea-49fb-a803-f75556d44f25 req-bb07431f-314a-4c53-8f64-f8f22d0cc589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1", "name": "network-vif-plugged", "status": "completed", "tag": "0340e0f7-d93d-41f2-9047-0d917af7db1c"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:38:43 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-75cc1ac0-72ea-49fb-a803-f75556d44f25 req-bb07431f-314a-4c53-8f64-f8f22d0cc589 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:43 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-75cc1ac0-72ea-49fb-a803-f75556d44f25 req-bb07431f-314a-4c53-8f64-f8f22d0cc589 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:43 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-75cc1ac0-72ea-49fb-a803-f75556d44f25 req-bb07431f-314a-4c53-8f64-f8f22d0cc589 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:43 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-75cc1ac0-72ea-49fb-a803-f75556d44f25 req-bb07431f-314a-4c53-8f64-f8f22d0cc589 service nova] Creating event network-vif-plugged:0340e0f7-d93d-41f2-9047-0d917af7db1c for instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 on user Apr 18 14:38:43 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-75cc1ac0-72ea-49fb-a803-f75556d44f25 req-bb07431f-314a-4c53-8f64-f8f22d0cc589 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056619 Apr 18 14:38:43 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 112/339] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:38:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:38:54 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-56393164-79ea-406e-bc32-ab3bbb6763a5 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:38:54 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-56393164-79ea-406e-bc32-ab3bbb6763a5 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: b3543651-513e-446d-a15d-563bc0c76e5d] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:38:54 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:54 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:54 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:54 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:38:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-56393164-79ea-406e-bc32-ab3bbb6763a5 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-56393164-79ea-406e-bc32-ab3bbb6763a5 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-56393164-79ea-406e-bc32-ab3bbb6763a5 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-56393164-79ea-406e-bc32-ab3bbb6763a5 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:38:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-56393164-79ea-406e-bc32-ab3bbb6763a5 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:38:54 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-56393164-79ea-406e-bc32-ab3bbb6763a5 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:38:55 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-56393164-79ea-406e-bc32-ab3bbb6763a5 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:38:55 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-56393164-79ea-406e-bc32-ab3bbb6763a5 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:38:55 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-56393164-79ea-406e-bc32-ab3bbb6763a5 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:38:55 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-56393164-79ea-406e-bc32-ab3bbb6763a5 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d" status: 200 len: 1586 microversion: 2.20 time: 0.387856 Apr 18 14:38:55 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 115/340] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:38:54 2023] GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d => generated 1586 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-c2a995f7-9801-481f-a6db-f179ad5bd9c6 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-c2a995f7-9801-481f-a6db-f179ad5bd9c6 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] [instance: 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c2a995f7-9801-481f-a6db-f179ad5bd9c6 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c2a995f7-9801-481f-a6db-f179ad5bd9c6 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c2a995f7-9801-481f-a6db-f179ad5bd9c6 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c2a995f7-9801-481f-a6db-f179ad5bd9c6 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c2a995f7-9801-481f-a6db-f179ad5bd9c6 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c2a995f7-9801-481f-a6db-f179ad5bd9c6 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:05 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-c2a995f7-9801-481f-a6db-f179ad5bd9c6 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] HTTP exception thrown: Instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf could not be found. Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-c2a995f7-9801-481f-a6db-f179ad5bd9c6 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Request method failure captured: Apr 18 14:39:05 user devstack@n-api.service[61310]: request: GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf HTTP/1.1 Apr 18 14:39:05 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:39:05 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:39:05 user devstack@n-api.service[61310]: Connection: close Apr 18 14:39:05 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:39:05 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:39:05 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:39:05 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:39:05 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqk3xE8P2scNldc_W83psWIvd-Ffi4qq9Kr-9AE5ROzYMeWHXCgz70ha9X3Zo0By9IFeLT1MYswj3CGef60O_QuGwfYQN-SmlaWILzXcULurCKbQL9EbPoJfkKumJNGUIaFgcsEtG5tMeQpTJTcBnNyA10M3oGhbZxcYyktjXm5mtG8 Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Project-Id: 279c1fea5cfc423b94ca756ebafb2515 Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Project-Name: tempest-ServerActionsTestJSON-378426381 Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/279c1fea5cfc423b94ca756ebafb2515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/279c1fea5cfc423b94ca756ebafb2515"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/279c1fea5cfc423b94ca756ebafb2515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Tenant: tempest-ServerActionsTestJSON-378426381 Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Tenant-Id: 279c1fea5cfc423b94ca756ebafb2515 Apr 18 14:39:05 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-ServerActionsTestJSON-378426381 Apr 18 14:39:05 user devstack@n-api.service[61310]: X-User: tempest-ServerActionsTestJSON-378426381-project-member Apr 18 14:39:05 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:39:05 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:39:05 user devstack@n-api.service[61310]: X-User-Id: 614f7a3a8f3348df9d81f693e733905b Apr 18 14:39:05 user devstack@n-api.service[61310]: X-User-Name: tempest-ServerActionsTestJSON-378426381-project-member Apr 18 14:39:05 user devstack@n-api.service[61310]: method: > Apr 18 14:39:05 user devstack@n-api.service[61310]: exception: Instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf could not be found. Apr 18 14:39:05 user devstack@n-api.service[61310]: action_args: {'id': '1f7c5ef9-09d6-477f-90a8-e6673f75b2cf'} Apr 18 14:39:05 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf could not be found. Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf could not be found. Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf could not be found. Apr 18 14:39:05 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:39:05 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-c2a995f7-9801-481f-a6db-f179ad5bd9c6 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Returning 404 to user: Instance 1f7c5ef9-09d6-477f-90a8-e6673f75b2cf could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:39:05 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-c2a995f7-9801-481f-a6db-f179ad5bd9c6 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf" status: 404 len: 111 microversion: 2.1 time: 0.038624 Apr 18 14:39:05 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 114/341] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:39:05 2023] GET /compute/v2.1/servers/1f7c5ef9-09d6-477f-90a8-e6673f75b2cf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:39:05 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:05 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:05 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:05 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-5a8d6647-9473-42ed-96fd-717391711926 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] Calling method '.version_select at 0x7f5cee94c5e0>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:39:05 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-5a8d6647-9473-42ed-96fd-717391711926 tempest-ServerActionsTestJSON-378426381 tempest-ServerActionsTestJSON-378426381-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-962705370" status: 202 len: 0 microversion: 2.1 time: 0.033981 Apr 18 14:39:05 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 113/342] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 14:39:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-962705370 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:39:15 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:15 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:15 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-3ea1d341-13d2-42c7-bb23-224720f68950 tempest-TestShelveInstance-733683598 tempest-TestShelveInstance-733683598-project-member] Action: 'create', calling method: .version_select at 0x7f5cee9db910>, body: {"keypair": {"name": "tempest-TestShelveInstance-265088924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoTE+QcYmtWqegAauDG7cKJ7x6ewLdeN45IV2bO0m2MLdEkfzub0LLTk56RK4nlGntKv1RBRPgdFB/Ch8MdCzoVWE+v+gZo3RQox9MGalaptE7IO/3TxMS50dc08JSFaA=="}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:39:15 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-3ea1d341-13d2-42c7-bb23-224720f68950 tempest-TestShelveInstance-733683598 tempest-TestShelveInstance-733683598-project-member] Getting quotas for project 3e9da521b6bc4eccb0bb6da002db3bcf. Resources: {'key_pairs'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:39:15 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-3ea1d341-13d2-42c7-bb23-224720f68950 tempest-TestShelveInstance-733683598 tempest-TestShelveInstance-733683598-project-member] Getting quotas for user 1b2f3fb19b2e4f868aacae914e94d1af and project 3e9da521b6bc4eccb0bb6da002db3bcf. Resources: {'key_pairs'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:39:15 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-3ea1d341-13d2-42c7-bb23-224720f68950 tempest-TestShelveInstance-733683598 tempest-TestShelveInstance-733683598-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.223315 Apr 18 14:39:15 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 116/343] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:39:15 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:39:18 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:18 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:18 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1710360904", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "networks": [{"uuid": "8edeafd7-9a4e-4c72-b1e3-a40f1a6e70aa"}]}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:39:18 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:18 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-25d529eb-22ba-495c-ac7b-b77acb3f0556 tempest-TestShelveInstance-733683598 tempest-TestShelveInstance-733683598-project-member] Calling method '.version_select at 0x7f5cee88e320>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:39:18 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-25d529eb-22ba-495c-ac7b-b77acb3f0556 tempest-TestShelveInstance-733683598 tempest-TestShelveInstance-733683598-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-265088924" status: 202 len: 0 microversion: 2.1 time: 0.023706 Apr 18 14:39:18 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 114/344] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 18 14:39:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-265088924 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:39:18 user devstack@n-api.service[61310]: DEBUG nova.network.neutron [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] validate_networks() for [('8edeafd7-9a4e-4c72-b1e3-a40f1a6e70aa', None, None, None, None, None)] {{(pid=61310) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Flavor limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Image limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Flavor pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Image pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Getting quotas for project f1bb3c50254545ff88c6bb55ccd16e7c. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Getting quotas for user bf32806393ed4030970e1a6e445bc43d and project f1bb3c50254545ff88c6bb55ccd16e7c. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Going to run 1 instances... {{(pid=61310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:39:19 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 149dbe97-118a-4187-b728-f71470c80e98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:39:19 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-d606b58c-d0a3-4672-a1ea-526f1353ddab tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.049504 Apr 18 14:39:19 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 115/345] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 14:39:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 14:39:19 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-4e01e0c3-6104-4944-b8ea-60e24036baa4 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:39:19 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-4e01e0c3-6104-4944-b8ea-60e24036baa4 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 149dbe97-118a-4187-b728-f71470c80e98] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:39:19 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-4e01e0c3-6104-4944-b8ea-60e24036baa4 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:39:19 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-4e01e0c3-6104-4944-b8ea-60e24036baa4 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:39:19 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-4e01e0c3-6104-4944-b8ea-60e24036baa4 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:39:19 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-4e01e0c3-6104-4944-b8ea-60e24036baa4 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98" status: 200 len: 1395 microversion: 2.87 time: 0.130470 Apr 18 14:39:19 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 117/346] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:39:19 2023] GET /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98 => generated 1395 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 18 14:39:22 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-39111fae-5fbd-4dde-913c-54ec7ce81b33 req-ca21d79c-0202-480d-bd3a-d1481ddef3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149dbe97-118a-4187-b728-f71470c80e98", "tag": "424e80fe-2145-4fb2-a3e6-f4eee6965c09"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:39:22 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-39111fae-5fbd-4dde-913c-54ec7ce81b33 req-ca21d79c-0202-480d-bd3a-d1481ddef3dd service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:22 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-39111fae-5fbd-4dde-913c-54ec7ce81b33 req-ca21d79c-0202-480d-bd3a-d1481ddef3dd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:22 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-39111fae-5fbd-4dde-913c-54ec7ce81b33 req-ca21d79c-0202-480d-bd3a-d1481ddef3dd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:22 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-39111fae-5fbd-4dde-913c-54ec7ce81b33 req-ca21d79c-0202-480d-bd3a-d1481ddef3dd service nova] Creating event network-changed:424e80fe-2145-4fb2-a3e6-f4eee6965c09 for instance 149dbe97-118a-4187-b728-f71470c80e98 on user Apr 18 14:39:22 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-39111fae-5fbd-4dde-913c-54ec7ce81b33 req-ca21d79c-0202-480d-bd3a-d1481ddef3dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030780 Apr 18 14:39:22 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 115/347] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:39:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:39:24 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-3c621526-a8dd-49ca-ad2c-114282676feb req-c2383a32-4554-4abb-b75c-3c052aa21e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149dbe97-118a-4187-b728-f71470c80e98", "name": "network-vif-plugged", "status": "completed", "tag": "424e80fe-2145-4fb2-a3e6-f4eee6965c09"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:39:24 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-3c621526-a8dd-49ca-ad2c-114282676feb req-c2383a32-4554-4abb-b75c-3c052aa21e36 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:24 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-3c621526-a8dd-49ca-ad2c-114282676feb req-c2383a32-4554-4abb-b75c-3c052aa21e36 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:24 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-3c621526-a8dd-49ca-ad2c-114282676feb req-c2383a32-4554-4abb-b75c-3c052aa21e36 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:24 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-3c621526-a8dd-49ca-ad2c-114282676feb req-c2383a32-4554-4abb-b75c-3c052aa21e36 service nova] Creating event network-vif-plugged:424e80fe-2145-4fb2-a3e6-f4eee6965c09 for instance 149dbe97-118a-4187-b728-f71470c80e98 on user Apr 18 14:39:24 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-3c621526-a8dd-49ca-ad2c-114282676feb req-c2383a32-4554-4abb-b75c-3c052aa21e36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090779 Apr 18 14:39:24 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 116/348] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:39:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:39:26 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-ebf9652d-0c07-49bf-95a5-d0288822d4ed req-a0f9ed9f-5a8f-4cf2-894f-a331130f2a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149dbe97-118a-4187-b728-f71470c80e98", "name": "network-vif-plugged", "status": "completed", "tag": "424e80fe-2145-4fb2-a3e6-f4eee6965c09"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:39:26 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-ebf9652d-0c07-49bf-95a5-d0288822d4ed req-a0f9ed9f-5a8f-4cf2-894f-a331130f2a24 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:26 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-ebf9652d-0c07-49bf-95a5-d0288822d4ed req-a0f9ed9f-5a8f-4cf2-894f-a331130f2a24 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:26 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-ebf9652d-0c07-49bf-95a5-d0288822d4ed req-a0f9ed9f-5a8f-4cf2-894f-a331130f2a24 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:26 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-ebf9652d-0c07-49bf-95a5-d0288822d4ed req-a0f9ed9f-5a8f-4cf2-894f-a331130f2a24 service nova] Creating event network-vif-plugged:424e80fe-2145-4fb2-a3e6-f4eee6965c09 for instance 149dbe97-118a-4187-b728-f71470c80e98 on user Apr 18 14:39:26 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-ebf9652d-0c07-49bf-95a5-d0288822d4ed req-a0f9ed9f-5a8f-4cf2-894f-a331130f2a24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033698 Apr 18 14:39:26 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 118/349] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:39:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:39:27 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-4a53cc69-7978-49d4-8e62-7e1a1c6ae221 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:39:27 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-4a53cc69-7978-49d4-8e62-7e1a1c6ae221 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:39:27 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a53cc69-7978-49d4-8e62-7e1a1c6ae221 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:27 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a53cc69-7978-49d4-8e62-7e1a1c6ae221 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:27 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a53cc69-7978-49d4-8e62-7e1a1c6ae221 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:27 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a53cc69-7978-49d4-8e62-7e1a1c6ae221 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:27 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a53cc69-7978-49d4-8e62-7e1a1c6ae221 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:27 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4a53cc69-7978-49d4-8e62-7e1a1c6ae221 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:27 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-4a53cc69-7978-49d4-8e62-7e1a1c6ae221 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd536529724c41980d5f2fddd8c71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38cf2921e9c49b98933eb439c2ea431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:39:27 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-4a53cc69-7978-49d4-8e62-7e1a1c6ae221 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1" status: 200 len: 1544 microversion: 2.1 time: 0.399385 Apr 18 14:39:27 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 116/350] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:39:27 2023] GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 => generated 1544 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:39:44 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:44 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:44 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:44 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:44 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-b8333b3d-5c51-489f-b218-2807a2633ff4 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Action: 'create', calling method: .version_select at 0x7f5ceeafb520>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-358630619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWhqauAaPzGjkOaH2KsedFwFl1cuK0dFRuTnWHpET+H1mhRkm4A0KSTxq0Si1RnsMG0PuVOKCGbYZefRukvrTLuyGGApFl+xxMcOBZB5z6LHrrkBDFSLzXUFo6zPKrrXQ=="}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:39:44 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-b8333b3d-5c51-489f-b218-2807a2633ff4 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Getting quotas for project 4668f5858e4246209a2057c984e499dc. Resources: {'key_pairs'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:39:44 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-b8333b3d-5c51-489f-b218-2807a2633ff4 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Getting quotas for user f30bc97702e14959b6510ee0b8855cac and project 4668f5858e4246209a2057c984e499dc. Resources: {'key_pairs'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:39:44 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-b8333b3d-5c51-489f-b218-2807a2633ff4 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.260167 Apr 18 14:39:44 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 117/351] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:39:44 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:39:45 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:45 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:45 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:45 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-781422116", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-358630619", "security_groups": [{"name": "tempest-secgroup-smoke-1279253006"}], "networks": [{"uuid": "35e012ce-98ed-4e71-aec9-4b66f8a6d50d"}]}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:39:45 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] validate_networks() for [('35e012ce-98ed-4e71-aec9-4b66f8a6d50d', None, None, None, None, None)] {{(pid=61309) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Flavor limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Image limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Flavor pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Image pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Getting quotas for project 4668f5858e4246209a2057c984e499dc. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Getting quotas for user f30bc97702e14959b6510ee0b8855cac and project 4668f5858e4246209a2057c984e499dc. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Going to run 1 instances... {{(pid=61309) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:39:46 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] [instance: 2da160d0-3fc5-43ef-a864-87c2d356643f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61309) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:39:46 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-e1d27645-2fa3-49d7-8202-ed330e66cdff tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.722875 Apr 18 14:39:46 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 119/352] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:39:45 2023] POST /compute/v2.1/servers => generated 404 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:39:46 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-4348494a-cccc-437e-bb9f-9c28c3934604 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:39:46 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-4348494a-cccc-437e-bb9f-9c28c3934604 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] [instance: 2da160d0-3fc5-43ef-a864-87c2d356643f] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:39:46 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:46 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=8 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:46 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-4348494a-cccc-437e-bb9f-9c28c3934604 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30bc97702e14959b6510ee0b8855cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4668f5858e4246209a2057c984e499dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:39:46 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-4348494a-cccc-437e-bb9f-9c28c3934604 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f" status: 200 len: 1255 microversion: 2.1 time: 0.074828 Apr 18 14:39:46 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 117/353] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:39:46 2023] GET /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f => generated 1255 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:39:49 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-6d3f1c97-9e2b-4a06-92ce-3fe49bf36662 req-5c1c6b35-51f9-4170-b504-7361507ba14d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da160d0-3fc5-43ef-a864-87c2d356643f", "tag": "461f6e18-0966-48ce-8d02-3fc895ad8887"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:39:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-6d3f1c97-9e2b-4a06-92ce-3fe49bf36662 req-5c1c6b35-51f9-4170-b504-7361507ba14d service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-6d3f1c97-9e2b-4a06-92ce-3fe49bf36662 req-5c1c6b35-51f9-4170-b504-7361507ba14d service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-6d3f1c97-9e2b-4a06-92ce-3fe49bf36662 req-5c1c6b35-51f9-4170-b504-7361507ba14d service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:49 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-6d3f1c97-9e2b-4a06-92ce-3fe49bf36662 req-5c1c6b35-51f9-4170-b504-7361507ba14d service nova] Creating event network-changed:461f6e18-0966-48ce-8d02-3fc895ad8887 for instance 2da160d0-3fc5-43ef-a864-87c2d356643f on user Apr 18 14:39:49 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-6d3f1c97-9e2b-4a06-92ce-3fe49bf36662 req-5c1c6b35-51f9-4170-b504-7361507ba14d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034060 Apr 18 14:39:49 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 118/354] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:39:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:39:51 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-7647b28a-4758-4188-85be-b9a13d06c4fb req-6237af8e-20e8-47b8-b52a-6c9bc372ed88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da160d0-3fc5-43ef-a864-87c2d356643f", "name": "network-vif-plugged", "status": "completed", "tag": "461f6e18-0966-48ce-8d02-3fc895ad8887"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:39:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-7647b28a-4758-4188-85be-b9a13d06c4fb req-6237af8e-20e8-47b8-b52a-6c9bc372ed88 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-7647b28a-4758-4188-85be-b9a13d06c4fb req-6237af8e-20e8-47b8-b52a-6c9bc372ed88 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:51 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-7647b28a-4758-4188-85be-b9a13d06c4fb req-6237af8e-20e8-47b8-b52a-6c9bc372ed88 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:51 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-7647b28a-4758-4188-85be-b9a13d06c4fb req-6237af8e-20e8-47b8-b52a-6c9bc372ed88 service nova] Creating event network-vif-plugged:461f6e18-0966-48ce-8d02-3fc895ad8887 for instance 2da160d0-3fc5-43ef-a864-87c2d356643f on user Apr 18 14:39:51 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-7647b28a-4758-4188-85be-b9a13d06c4fb req-6237af8e-20e8-47b8-b52a-6c9bc372ed88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033725 Apr 18 14:39:51 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 120/355] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:39:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:39:53 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-5bff6b8f-49fa-4b20-ad2f-d8de6fb24603 req-7adf8e8f-8040-4b4c-a869-6a112f19520f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da160d0-3fc5-43ef-a864-87c2d356643f", "name": "network-vif-plugged", "status": "completed", "tag": "461f6e18-0966-48ce-8d02-3fc895ad8887"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:39:53 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-5bff6b8f-49fa-4b20-ad2f-d8de6fb24603 req-7adf8e8f-8040-4b4c-a869-6a112f19520f service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:53 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-5bff6b8f-49fa-4b20-ad2f-d8de6fb24603 req-7adf8e8f-8040-4b4c-a869-6a112f19520f service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:53 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-5bff6b8f-49fa-4b20-ad2f-d8de6fb24603 req-7adf8e8f-8040-4b4c-a869-6a112f19520f service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:53 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-5bff6b8f-49fa-4b20-ad2f-d8de6fb24603 req-7adf8e8f-8040-4b4c-a869-6a112f19520f service nova] Creating event network-vif-plugged:461f6e18-0966-48ce-8d02-3fc895ad8887 for instance 2da160d0-3fc5-43ef-a864-87c2d356643f on user Apr 18 14:39:53 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-5bff6b8f-49fa-4b20-ad2f-d8de6fb24603 req-7adf8e8f-8040-4b4c-a869-6a112f19520f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031587 Apr 18 14:39:53 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 118/356] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:39:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:39:55 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:55 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-6cd9f0cb-bb95-416d-ab40-de6a506462ec tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:39:55 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-6cd9f0cb-bb95-416d-ab40-de6a506462ec tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: b3543651-513e-446d-a15d-563bc0c76e5d] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:39:55 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-6cd9f0cb-bb95-416d-ab40-de6a506462ec tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:55 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-6cd9f0cb-bb95-416d-ab40-de6a506462ec tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:55 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-6cd9f0cb-bb95-416d-ab40-de6a506462ec tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:55 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-6cd9f0cb-bb95-416d-ab40-de6a506462ec tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:55 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-6cd9f0cb-bb95-416d-ab40-de6a506462ec tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:55 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-6cd9f0cb-bb95-416d-ab40-de6a506462ec tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:55 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-6cd9f0cb-bb95-416d-ab40-de6a506462ec tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.166015 Apr 18 14:39:55 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 119/357] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 14:39:55 2023] GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d/os-interface => generated 283 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:39:56 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:56 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:56 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-c5879433-8ef4-4fe8-afc0-c5b22e4b8a35 req-b678be82-fc8a-4229-a213-58a755773291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3543651-513e-446d-a15d-563bc0c76e5d", "tag": "2278d6f2-24ff-4870-9be5-a5fae51c37b1"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:39:56 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-c5879433-8ef4-4fe8-afc0-c5b22e4b8a35 req-b678be82-fc8a-4229-a213-58a755773291 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:56 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-c5879433-8ef4-4fe8-afc0-c5b22e4b8a35 req-b678be82-fc8a-4229-a213-58a755773291 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:56 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-c5879433-8ef4-4fe8-afc0-c5b22e4b8a35 req-b678be82-fc8a-4229-a213-58a755773291 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:56 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-c5879433-8ef4-4fe8-afc0-c5b22e4b8a35 req-b678be82-fc8a-4229-a213-58a755773291 service nova] Creating event network-changed:2278d6f2-24ff-4870-9be5-a5fae51c37b1 for instance b3543651-513e-446d-a15d-563bc0c76e5d on user Apr 18 14:39:56 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-c5879433-8ef4-4fe8-afc0-c5b22e4b8a35 req-b678be82-fc8a-4229-a213-58a755773291 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034721 Apr 18 14:39:56 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 121/358] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:39:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:39:56 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-1794555c-f5db-4849-975b-4581897a8d57 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:39:56 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-1794555c-f5db-4849-975b-4581897a8d57 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: b3543651-513e-446d-a15d-563bc0c76e5d] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:39:56 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:39:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-1794555c-f5db-4849-975b-4581897a8d57 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-1794555c-f5db-4849-975b-4581897a8d57 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-1794555c-f5db-4849-975b-4581897a8d57 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-1794555c-f5db-4849-975b-4581897a8d57 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-1794555c-f5db-4849-975b-4581897a8d57 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:56 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-1794555c-f5db-4849-975b-4581897a8d57 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:56 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-1794555c-f5db-4849-975b-4581897a8d57 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d/ips" status: 200 len: 111 microversion: 2.20 time: 0.053832 Apr 18 14:39:56 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 119/359] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 14:39:56 2023] GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d/ips => generated 111 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:39:58 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-f21b1270-7939-473a-adb7-8492e186a489 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:39:58 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-f21b1270-7939-473a-adb7-8492e186a489 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: b3543651-513e-446d-a15d-563bc0c76e5d] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:39:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-f21b1270-7939-473a-adb7-8492e186a489 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-f21b1270-7939-473a-adb7-8492e186a489 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-f21b1270-7939-473a-adb7-8492e186a489 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-f21b1270-7939-473a-adb7-8492e186a489 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-f21b1270-7939-473a-adb7-8492e186a489 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-f21b1270-7939-473a-adb7-8492e186a489 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:58 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-f21b1270-7939-473a-adb7-8492e186a489 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: b3543651-513e-446d-a15d-563bc0c76e5d] Going to try to terminate instance {{(pid=61310) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:39:58 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-f21b1270-7939-473a-adb7-8492e186a489 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d" status: 204 len: 0 microversion: 2.20 time: 0.145482 Apr 18 14:39:58 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 120/360] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 14:39:58 2023] DELETE /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 14:39:58 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-e5180daf-02f4-43c4-9d11-180856bc3e4e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:39:58 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-e5180daf-02f4-43c4-9d11-180856bc3e4e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: b3543651-513e-446d-a15d-563bc0c76e5d] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:39:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e5180daf-02f4-43c4-9d11-180856bc3e4e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e5180daf-02f4-43c4-9d11-180856bc3e4e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e5180daf-02f4-43c4-9d11-180856bc3e4e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e5180daf-02f4-43c4-9d11-180856bc3e4e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e5180daf-02f4-43c4-9d11-180856bc3e4e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-e5180daf-02f4-43c4-9d11-180856bc3e4e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:58 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-e5180daf-02f4-43c4-9d11-180856bc3e4e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:39:58 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-e5180daf-02f4-43c4-9d11-180856bc3e4e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:39:58 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-e5180daf-02f4-43c4-9d11-180856bc3e4e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:39:58 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-e5180daf-02f4-43c4-9d11-180856bc3e4e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d" status: 200 len: 1711 microversion: 2.20 time: 0.208767 Apr 18 14:39:58 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 122/361] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:39:58 2023] GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d => generated 1711 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 18 14:39:58 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-402c58d6-3e9f-4744-89bf-46ff9179549a req-5805548f-2a14-470a-a22d-2de9f0f04b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3543651-513e-446d-a15d-563bc0c76e5d", "name": "network-vif-unplugged", "status": "completed", "tag": "2278d6f2-24ff-4870-9be5-a5fae51c37b1"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:39:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-402c58d6-3e9f-4744-89bf-46ff9179549a req-5805548f-2a14-470a-a22d-2de9f0f04b8c service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:39:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-402c58d6-3e9f-4744-89bf-46ff9179549a req-5805548f-2a14-470a-a22d-2de9f0f04b8c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:39:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-402c58d6-3e9f-4744-89bf-46ff9179549a req-5805548f-2a14-470a-a22d-2de9f0f04b8c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:39:58 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-402c58d6-3e9f-4744-89bf-46ff9179549a req-5805548f-2a14-470a-a22d-2de9f0f04b8c service nova] Creating event network-vif-unplugged:2278d6f2-24ff-4870-9be5-a5fae51c37b1 for instance b3543651-513e-446d-a15d-563bc0c76e5d on user Apr 18 14:39:58 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-402c58d6-3e9f-4744-89bf-46ff9179549a req-5805548f-2a14-470a-a22d-2de9f0f04b8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134378 Apr 18 14:39:58 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 120/362] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:39:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:40:00 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-47777f76-882f-415a-b3b1-29cee2bd250f req-66895e51-3b78-48ee-831f-3d4ac61c0c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3543651-513e-446d-a15d-563bc0c76e5d", "name": "network-vif-deleted", "tag": "2278d6f2-24ff-4870-9be5-a5fae51c37b1"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:40:00 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-47777f76-882f-415a-b3b1-29cee2bd250f req-66895e51-3b78-48ee-831f-3d4ac61c0c85 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:00 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-47777f76-882f-415a-b3b1-29cee2bd250f req-66895e51-3b78-48ee-831f-3d4ac61c0c85 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:00 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-47777f76-882f-415a-b3b1-29cee2bd250f req-66895e51-3b78-48ee-831f-3d4ac61c0c85 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:00 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-47777f76-882f-415a-b3b1-29cee2bd250f req-66895e51-3b78-48ee-831f-3d4ac61c0c85 service nova] Creating event network-vif-deleted:2278d6f2-24ff-4870-9be5-a5fae51c37b1 for instance b3543651-513e-446d-a15d-563bc0c76e5d on user Apr 18 14:40:00 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-47777f76-882f-415a-b3b1-29cee2bd250f req-66895e51-3b78-48ee-831f-3d4ac61c0c85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034483 Apr 18 14:40:00 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 121/363] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:40:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:40:00 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-416167b3-f6ce-43bf-a002-a438b11e9f40 req-6ed35c60-7906-4ebb-bcc7-e9722a6eb1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3543651-513e-446d-a15d-563bc0c76e5d", "name": "network-vif-plugged", "status": "completed", "tag": "2278d6f2-24ff-4870-9be5-a5fae51c37b1"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:40:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-416167b3-f6ce-43bf-a002-a438b11e9f40 req-6ed35c60-7906-4ebb-bcc7-e9722a6eb1aa service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-416167b3-f6ce-43bf-a002-a438b11e9f40 req-6ed35c60-7906-4ebb-bcc7-e9722a6eb1aa service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-416167b3-f6ce-43bf-a002-a438b11e9f40 req-6ed35c60-7906-4ebb-bcc7-e9722a6eb1aa service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:00 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-416167b3-f6ce-43bf-a002-a438b11e9f40 req-6ed35c60-7906-4ebb-bcc7-e9722a6eb1aa service nova] Creating event network-vif-plugged:2278d6f2-24ff-4870-9be5-a5fae51c37b1 for instance b3543651-513e-446d-a15d-563bc0c76e5d on user Apr 18 14:40:00 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-416167b3-f6ce-43bf-a002-a438b11e9f40 req-6ed35c60-7906-4ebb-bcc7-e9722a6eb1aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032370 Apr 18 14:40:00 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 123/364] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:40:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:40:09 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=10 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:09 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=8 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:09 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-247f63cc-cc73-49b7-ac5c-5ca358a082c9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:40:09 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-247f63cc-cc73-49b7-ac5c-5ca358a082c9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 149dbe97-118a-4187-b728-f71470c80e98] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:40:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-247f63cc-cc73-49b7-ac5c-5ca358a082c9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-247f63cc-cc73-49b7-ac5c-5ca358a082c9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-247f63cc-cc73-49b7-ac5c-5ca358a082c9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-247f63cc-cc73-49b7-ac5c-5ca358a082c9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-247f63cc-cc73-49b7-ac5c-5ca358a082c9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-247f63cc-cc73-49b7-ac5c-5ca358a082c9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:10 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-247f63cc-cc73-49b7-ac5c-5ca358a082c9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:40:10 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-247f63cc-cc73-49b7-ac5c-5ca358a082c9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:40:10 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-247f63cc-cc73-49b7-ac5c-5ca358a082c9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:40:10 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-247f63cc-cc73-49b7-ac5c-5ca358a082c9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98" status: 200 len: 1692 microversion: 2.87 time: 0.460663 Apr 18 14:40:10 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 121/365] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:40:09 2023] GET /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98 => generated 1692 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:40:27 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:27 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:27 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-3f7a8bb9-ed25-44a7-9095-fa2ad6644606 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:40:27 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-3f7a8bb9-ed25-44a7-9095-fa2ad6644606 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:40:27 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3f7a8bb9-ed25-44a7-9095-fa2ad6644606 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:27 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3f7a8bb9-ed25-44a7-9095-fa2ad6644606 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:27 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3f7a8bb9-ed25-44a7-9095-fa2ad6644606 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:27 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3f7a8bb9-ed25-44a7-9095-fa2ad6644606 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:27 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3f7a8bb9-ed25-44a7-9095-fa2ad6644606 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:27 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3f7a8bb9-ed25-44a7-9095-fa2ad6644606 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:28 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-3f7a8bb9-ed25-44a7-9095-fa2ad6644606 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.194422 Apr 18 14:40:28 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 122/366] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 14:40:27 2023] GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1/os-interface => generated 283 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:40:29 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:29 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=14 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:29 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-da47e00a-379c-4b14-bf05-bf25e0c04057 req-fc3ca04b-fb42-4041-94bc-88581219d273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1", "tag": "0340e0f7-d93d-41f2-9047-0d917af7db1c"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:40:29 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-da47e00a-379c-4b14-bf05-bf25e0c04057 req-fc3ca04b-fb42-4041-94bc-88581219d273 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:29 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-da47e00a-379c-4b14-bf05-bf25e0c04057 req-fc3ca04b-fb42-4041-94bc-88581219d273 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:29 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-da47e00a-379c-4b14-bf05-bf25e0c04057 req-fc3ca04b-fb42-4041-94bc-88581219d273 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:29 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-da47e00a-379c-4b14-bf05-bf25e0c04057 req-fc3ca04b-fb42-4041-94bc-88581219d273 service nova] Creating event network-changed:0340e0f7-d93d-41f2-9047-0d917af7db1c for instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 on user Apr 18 14:40:29 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-da47e00a-379c-4b14-bf05-bf25e0c04057 req-fc3ca04b-fb42-4041-94bc-88581219d273 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033563 Apr 18 14:40:29 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 124/367] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:40:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:40:29 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:29 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:29 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-f17246aa-266a-4819-b8b7-e4cba2d22bb7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:40:29 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-f17246aa-266a-4819-b8b7-e4cba2d22bb7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:40:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-f17246aa-266a-4819-b8b7-e4cba2d22bb7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-f17246aa-266a-4819-b8b7-e4cba2d22bb7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-f17246aa-266a-4819-b8b7-e4cba2d22bb7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-f17246aa-266a-4819-b8b7-e4cba2d22bb7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-f17246aa-266a-4819-b8b7-e4cba2d22bb7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-f17246aa-266a-4819-b8b7-e4cba2d22bb7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:29 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-f17246aa-266a-4819-b8b7-e4cba2d22bb7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1/ips" status: 200 len: 109 microversion: 2.1 time: 0.037798 Apr 18 14:40:29 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 122/368] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 14:40:29 2023] GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1/ips => generated 109 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:40:30 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-0af16b84-c272-42aa-ab41-3533f93e002c tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:40:30 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-0af16b84-c272-42aa-ab41-3533f93e002c tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:40:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0af16b84-c272-42aa-ab41-3533f93e002c tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0af16b84-c272-42aa-ab41-3533f93e002c tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0af16b84-c272-42aa-ab41-3533f93e002c tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0af16b84-c272-42aa-ab41-3533f93e002c tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0af16b84-c272-42aa-ab41-3533f93e002c tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:30 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0af16b84-c272-42aa-ab41-3533f93e002c tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:30 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-0af16b84-c272-42aa-ab41-3533f93e002c tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1] Going to try to terminate instance {{(pid=61310) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:40:30 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-0af16b84-c272-42aa-ab41-3533f93e002c tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1" status: 204 len: 0 microversion: 2.1 time: 0.106983 Apr 18 14:40:30 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 123/369] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:40:30 2023] DELETE /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:40:30 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-28eb8fcb-3456-49e4-9f54-484d23ddd436 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:40:30 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-28eb8fcb-3456-49e4-9f54-484d23ddd436 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:40:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-28eb8fcb-3456-49e4-9f54-484d23ddd436 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-28eb8fcb-3456-49e4-9f54-484d23ddd436 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-28eb8fcb-3456-49e4-9f54-484d23ddd436 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-28eb8fcb-3456-49e4-9f54-484d23ddd436 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-28eb8fcb-3456-49e4-9f54-484d23ddd436 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:30 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-28eb8fcb-3456-49e4-9f54-484d23ddd436 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:30 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-28eb8fcb-3456-49e4-9f54-484d23ddd436 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd536529724c41980d5f2fddd8c71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38cf2921e9c49b98933eb439c2ea431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:40:30 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-28eb8fcb-3456-49e4-9f54-484d23ddd436 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1" status: 200 len: 1668 microversion: 2.1 time: 0.202937 Apr 18 14:40:30 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 125/370] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:40:30 2023] GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 => generated 1668 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:40:31 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-16a626a3-e013-4f3f-8a3f-3d2a9b3b8f07 req-e160fac1-fe1a-4af2-adbe-c31ccffe7fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1", "name": "network-vif-unplugged", "status": "completed", "tag": "0340e0f7-d93d-41f2-9047-0d917af7db1c"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:40:31 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-16a626a3-e013-4f3f-8a3f-3d2a9b3b8f07 req-e160fac1-fe1a-4af2-adbe-c31ccffe7fdb service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:31 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-16a626a3-e013-4f3f-8a3f-3d2a9b3b8f07 req-e160fac1-fe1a-4af2-adbe-c31ccffe7fdb service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:31 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-16a626a3-e013-4f3f-8a3f-3d2a9b3b8f07 req-e160fac1-fe1a-4af2-adbe-c31ccffe7fdb service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:31 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-16a626a3-e013-4f3f-8a3f-3d2a9b3b8f07 req-e160fac1-fe1a-4af2-adbe-c31ccffe7fdb service nova] Creating event network-vif-unplugged:0340e0f7-d93d-41f2-9047-0d917af7db1c for instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 on user Apr 18 14:40:31 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-16a626a3-e013-4f3f-8a3f-3d2a9b3b8f07 req-e160fac1-fe1a-4af2-adbe-c31ccffe7fdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090399 Apr 18 14:40:31 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 123/371] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:40:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:40:32 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-deae193d-860b-4f53-82e0-f5abad5dbb14 req-82e138d9-f1e6-4fe0-a50c-38700cdde197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1", "name": "network-vif-deleted", "tag": "0340e0f7-d93d-41f2-9047-0d917af7db1c"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:40:32 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-deae193d-860b-4f53-82e0-f5abad5dbb14 req-82e138d9-f1e6-4fe0-a50c-38700cdde197 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:32 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-deae193d-860b-4f53-82e0-f5abad5dbb14 req-82e138d9-f1e6-4fe0-a50c-38700cdde197 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:32 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-deae193d-860b-4f53-82e0-f5abad5dbb14 req-82e138d9-f1e6-4fe0-a50c-38700cdde197 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:32 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-deae193d-860b-4f53-82e0-f5abad5dbb14 req-82e138d9-f1e6-4fe0-a50c-38700cdde197 service nova] Creating event network-vif-deleted:0340e0f7-d93d-41f2-9047-0d917af7db1c for instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 on user Apr 18 14:40:32 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-deae193d-860b-4f53-82e0-f5abad5dbb14 req-82e138d9-f1e6-4fe0-a50c-38700cdde197 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029394 Apr 18 14:40:32 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 124/372] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:40:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:40:33 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-4b753309-cbbc-48d2-92cc-5c2152ab99e6 req-78ff9b34-4eee-4d8b-89cf-dd09ebae79bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1", "name": "network-vif-plugged", "status": "completed", "tag": "0340e0f7-d93d-41f2-9047-0d917af7db1c"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:40:33 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-4b753309-cbbc-48d2-92cc-5c2152ab99e6 req-78ff9b34-4eee-4d8b-89cf-dd09ebae79bd service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:33 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-4b753309-cbbc-48d2-92cc-5c2152ab99e6 req-78ff9b34-4eee-4d8b-89cf-dd09ebae79bd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:33 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-4b753309-cbbc-48d2-92cc-5c2152ab99e6 req-78ff9b34-4eee-4d8b-89cf-dd09ebae79bd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:33 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-4b753309-cbbc-48d2-92cc-5c2152ab99e6 req-78ff9b34-4eee-4d8b-89cf-dd09ebae79bd service nova] Creating event network-vif-plugged:0340e0f7-d93d-41f2-9047-0d917af7db1c for instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 on user Apr 18 14:40:33 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-4b753309-cbbc-48d2-92cc-5c2152ab99e6 req-78ff9b34-4eee-4d8b-89cf-dd09ebae79bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030679 Apr 18 14:40:33 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 126/373] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:40:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:40:36 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-e1f2e517-60eb-420f-8352-e0aa04b08461 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:40:36 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-e1f2e517-60eb-420f-8352-e0aa04b08461 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] [instance: 2da160d0-3fc5-43ef-a864-87c2d356643f] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:40:36 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e1f2e517-60eb-420f-8352-e0aa04b08461 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:36 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e1f2e517-60eb-420f-8352-e0aa04b08461 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:36 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e1f2e517-60eb-420f-8352-e0aa04b08461 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:36 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e1f2e517-60eb-420f-8352-e0aa04b08461 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:36 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e1f2e517-60eb-420f-8352-e0aa04b08461 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:36 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e1f2e517-60eb-420f-8352-e0aa04b08461 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:36 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-e1f2e517-60eb-420f-8352-e0aa04b08461 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30bc97702e14959b6510ee0b8855cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4668f5858e4246209a2057c984e499dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:40:36 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-e1f2e517-60eb-420f-8352-e0aa04b08461 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f" status: 200 len: 1568 microversion: 2.1 time: 0.267624 Apr 18 14:40:36 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 124/374] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:40:36 2023] GET /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:40:48 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:48 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:48 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-cd8ec333-d926-474c-8b46-ad6fbffcdff0 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:40:48 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-cd8ec333-d926-474c-8b46-ad6fbffcdff0 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: b3543651-513e-446d-a15d-563bc0c76e5d] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:40:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-cd8ec333-d926-474c-8b46-ad6fbffcdff0 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-cd8ec333-d926-474c-8b46-ad6fbffcdff0 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-cd8ec333-d926-474c-8b46-ad6fbffcdff0 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-cd8ec333-d926-474c-8b46-ad6fbffcdff0 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-cd8ec333-d926-474c-8b46-ad6fbffcdff0 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-cd8ec333-d926-474c-8b46-ad6fbffcdff0 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-cd8ec333-d926-474c-8b46-ad6fbffcdff0 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] HTTP exception thrown: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:40:48 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-cd8ec333-d926-474c-8b46-ad6fbffcdff0 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Request method failure captured: Apr 18 14:40:48 user devstack@n-api.service[61310]: request: GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d HTTP/1.1 Apr 18 14:40:48 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:40:48 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:40:48 user devstack@n-api.service[61310]: Connection: close Apr 18 14:40:48 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:40:48 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:40:48 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:40:48 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:40:48 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqtKkU5MpeLMBuKGu5HdiO_tYh4DTAbE29lVw-p-ZgLflh1T9DfOCEugqsQ6Q9Tetd83cYO7vUi1mpZ23BylbP5rwdOGdKANdr4o5CHFHGOVZve6ig9Qw9xToecjuNcwICa2745L-2_Y0EgnSnqAda34ahy5og6vpI8pwkR-9YQttec Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Project-Id: 3549c53be65e4fc2a2bb124109319ca2 Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Tenant-Id: 3549c53be65e4fc2a2bb124109319ca2 Apr 18 14:40:48 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:40:48 user devstack@n-api.service[61310]: X-User: tempest-AttachVolumeShelveTestJSON-1759405781-project-member Apr 18 14:40:48 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:40:48 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:40:48 user devstack@n-api.service[61310]: X-User-Id: 8b4ce9342145403c9ba6a9871fbf490e Apr 18 14:40:48 user devstack@n-api.service[61310]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1759405781-project-member Apr 18 14:40:48 user devstack@n-api.service[61310]: method: > Apr 18 14:40:48 user devstack@n-api.service[61310]: exception: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:40:48 user devstack@n-api.service[61310]: action_args: {'id': 'b3543651-513e-446d-a15d-563bc0c76e5d'} Apr 18 14:40:48 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:40:48 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:40:48 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-cd8ec333-d926-474c-8b46-ad6fbffcdff0 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Returning 404 to user: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:40:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-cd8ec333-d926-474c-8b46-ad6fbffcdff0 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d" status: 404 len: 111 microversion: 2.20 time: 0.035200 Apr 18 14:40:48 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 125/375] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:40:48 2023] GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 14:40:48 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:48 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=10 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:48 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-8f6da247-2543-4b5b-a07e-76ad83a83070 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '.version_select at 0x7f5cee9d8c10>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:40:48 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-8f6da247-2543-4b5b-a07e-76ad83a83070 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-755706090" status: 204 len: 0 microversion: 2.20 time: 0.028706 Apr 18 14:40:48 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 127/376] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 18 14:40:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-755706090 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 14:40:49 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-430b08de-b35c-48fb-88e4-84c05d16d563 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Action: 'create', calling method: .version_select at 0x7f5cee94f490>, body: {"keypair": {"name": "tempest-keypair-2091878562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqw42oLTN2FNKnNbH44r0sydlRDm8DhSjKyUCYjTYehrJrhohKylHVpWKo1j1fdvSEHnXzelMKvI9OaP5gP/OLzC4q4j8qQPA9lFCP1Zd6+rTk226bslqZdhgDY4WbwBw=="}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:40:49 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:49 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=12 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:40:50 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-430b08de-b35c-48fb-88e4-84c05d16d563 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Getting quotas for project 3549c53be65e4fc2a2bb124109319ca2. Resources: {'key_pairs'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:40:50 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-430b08de-b35c-48fb-88e4-84c05d16d563 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Getting quotas for user 8b4ce9342145403c9ba6a9871fbf490e and project 3549c53be65e4fc2a2bb124109319ca2. Resources: {'key_pairs'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:40:50 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-430b08de-b35c-48fb-88e4-84c05d16d563 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.064643 Apr 18 14:40:50 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 125/377] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 14:40:49 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 66 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Apr 18 14:40:51 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-296248347", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "624f60ce-989c-4401-bbed-ba6d9b82f01c"}], "security_groups": [{"name": "tempest-securitygroup--1238747859"}], "key_name": "tempest-keypair-2091878562", "user_data": "}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:40:51 user devstack@n-api.service[61310]: DEBUG nova.network.neutron [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] validate_networks() for [('624f60ce-989c-4401-bbed-ba6d9b82f01c', None, None, None, None, None)] {{(pid=61310) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Flavor limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Image limits 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Flavor pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Image pref 0:0:0 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG nova.virt.hardware [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Getting quotas for project 3549c53be65e4fc2a2bb124109319ca2. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Getting quotas for user 8b4ce9342145403c9ba6a9871fbf490e and project 3549c53be65e4fc2a2bb124109319ca2. Resources: {'cores', 'ram', 'instances'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Going to run 1 instances... {{(pid=61310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:40:52 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: 47d56c29-010e-48a8-a1c6-8c62decfd02d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:40:52 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-eca7dab1-007d-4357-b55f-2ea4a0513b77 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.737056 Apr 18 14:40:52 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 126/378] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 14:40:51 2023] POST /compute/v2.1/servers => generated 400 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 14:40:52 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-038b478b-95e6-4153-9e71-b27855fcb111 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:40:52 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-038b478b-95e6-4153-9e71-b27855fcb111 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: 47d56c29-010e-48a8-a1c6-8c62decfd02d] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:40:52 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-038b478b-95e6-4153-9e71-b27855fcb111 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:40:52 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-038b478b-95e6-4153-9e71-b27855fcb111 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:40:52 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-038b478b-95e6-4153-9e71-b27855fcb111 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:40:52 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-038b478b-95e6-4153-9e71-b27855fcb111 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d" status: 200 len: 1275 microversion: 2.20 time: 0.068523 Apr 18 14:40:52 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 128/379] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:40:52 2023] GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d => generated 1275 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:40:55 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-f599cdd3-7d50-45d6-bc62-96b27e056523 req-25d2a7e2-142c-4ad3-bbc1-bfa71e6353d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d56c29-010e-48a8-a1c6-8c62decfd02d", "tag": "ac9004e4-83b8-4351-811a-b5d6a384cb3c"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:40:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-f599cdd3-7d50-45d6-bc62-96b27e056523 req-25d2a7e2-142c-4ad3-bbc1-bfa71e6353d2 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-f599cdd3-7d50-45d6-bc62-96b27e056523 req-25d2a7e2-142c-4ad3-bbc1-bfa71e6353d2 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:55 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-f599cdd3-7d50-45d6-bc62-96b27e056523 req-25d2a7e2-142c-4ad3-bbc1-bfa71e6353d2 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:55 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-f599cdd3-7d50-45d6-bc62-96b27e056523 req-25d2a7e2-142c-4ad3-bbc1-bfa71e6353d2 service nova] Creating event network-changed:ac9004e4-83b8-4351-811a-b5d6a384cb3c for instance 47d56c29-010e-48a8-a1c6-8c62decfd02d on user Apr 18 14:40:55 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-f599cdd3-7d50-45d6-bc62-96b27e056523 req-25d2a7e2-142c-4ad3-bbc1-bfa71e6353d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031797 Apr 18 14:40:55 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 126/380] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:40:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:40:57 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-14087b6e-7407-4577-85b7-1922968de6d7 req-feef1137-3699-4e2c-8cb7-e110d27e3b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d56c29-010e-48a8-a1c6-8c62decfd02d", "name": "network-vif-plugged", "status": "completed", "tag": "ac9004e4-83b8-4351-811a-b5d6a384cb3c"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:40:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-14087b6e-7407-4577-85b7-1922968de6d7 req-feef1137-3699-4e2c-8cb7-e110d27e3b24 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-14087b6e-7407-4577-85b7-1922968de6d7 req-feef1137-3699-4e2c-8cb7-e110d27e3b24 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:57 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-14087b6e-7407-4577-85b7-1922968de6d7 req-feef1137-3699-4e2c-8cb7-e110d27e3b24 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:57 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-14087b6e-7407-4577-85b7-1922968de6d7 req-feef1137-3699-4e2c-8cb7-e110d27e3b24 service nova] Creating event network-vif-plugged:ac9004e4-83b8-4351-811a-b5d6a384cb3c for instance 47d56c29-010e-48a8-a1c6-8c62decfd02d on user Apr 18 14:40:57 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-14087b6e-7407-4577-85b7-1922968de6d7 req-feef1137-3699-4e2c-8cb7-e110d27e3b24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040918 Apr 18 14:40:57 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 127/381] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:40:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:40:59 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-8db78ba0-9caf-4de4-b0cf-5a1ac2c4c3bb req-afbd5d90-e584-41c0-b136-40fa875ef69a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d56c29-010e-48a8-a1c6-8c62decfd02d", "name": "network-vif-plugged", "status": "completed", "tag": "ac9004e4-83b8-4351-811a-b5d6a384cb3c"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:40:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8db78ba0-9caf-4de4-b0cf-5a1ac2c4c3bb req-afbd5d90-e584-41c0-b136-40fa875ef69a service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:40:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8db78ba0-9caf-4de4-b0cf-5a1ac2c4c3bb req-afbd5d90-e584-41c0-b136-40fa875ef69a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:40:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-8db78ba0-9caf-4de4-b0cf-5a1ac2c4c3bb req-afbd5d90-e584-41c0-b136-40fa875ef69a service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:40:59 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-8db78ba0-9caf-4de4-b0cf-5a1ac2c4c3bb req-afbd5d90-e584-41c0-b136-40fa875ef69a service nova] Creating event network-vif-plugged:ac9004e4-83b8-4351-811a-b5d6a384cb3c for instance 47d56c29-010e-48a8-a1c6-8c62decfd02d on user Apr 18 14:40:59 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-8db78ba0-9caf-4de4-b0cf-5a1ac2c4c3bb req-afbd5d90-e584-41c0-b136-40fa875ef69a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029872 Apr 18 14:40:59 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 129/382] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:40:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:41:10 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-e1ac3f92-dfbb-494f-ae16-85c9b73e308f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-979284847"}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:41:10 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-e1ac3f92-dfbb-494f-ae16-85c9b73e308f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 149dbe97-118a-4187-b728-f71470c80e98] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:41:10 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:10 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:10 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e1ac3f92-dfbb-494f-ae16-85c9b73e308f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e1ac3f92-dfbb-494f-ae16-85c9b73e308f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e1ac3f92-dfbb-494f-ae16-85c9b73e308f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e1ac3f92-dfbb-494f-ae16-85c9b73e308f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e1ac3f92-dfbb-494f-ae16-85c9b73e308f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:10 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e1ac3f92-dfbb-494f-ae16-85c9b73e308f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:11 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-e1ac3f92-dfbb-494f-ae16-85c9b73e308f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "POST /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98/action" status: 202 len: 52 microversion: 2.87 time: 0.920127 Apr 18 14:41:11 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 127/383] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 14:41:10 2023] POST /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98/action => generated 52 bytes in 922 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-1c1b2531-3174-410d-bc6b-99b93e12c18f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-1c1b2531-3174-410d-bc6b-99b93e12c18f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 149dbe97-118a-4187-b728-f71470c80e98] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-1c1b2531-3174-410d-bc6b-99b93e12c18f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-1c1b2531-3174-410d-bc6b-99b93e12c18f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-1c1b2531-3174-410d-bc6b-99b93e12c18f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-1c1b2531-3174-410d-bc6b-99b93e12c18f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-1c1b2531-3174-410d-bc6b-99b93e12c18f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-1c1b2531-3174-410d-bc6b-99b93e12c18f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-1c1b2531-3174-410d-bc6b-99b93e12c18f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-1c1b2531-3174-410d-bc6b-99b93e12c18f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:41:16 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-1c1b2531-3174-410d-bc6b-99b93e12c18f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:41:16 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-1c1b2531-3174-410d-bc6b-99b93e12c18f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98" status: 200 len: 1692 microversion: 2.87 time: 0.331956 Apr 18 14:41:16 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 128/384] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:41:16 2023] GET /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98 => generated 1692 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:41:20 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:20 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:20 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:21 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-49a19e54-a627-43c2-b317-22c743dd8f9d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:41:21 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-49a19e54-a627-43c2-b317-22c743dd8f9d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:41:21 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-49a19e54-a627-43c2-b317-22c743dd8f9d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:21 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-49a19e54-a627-43c2-b317-22c743dd8f9d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:21 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-49a19e54-a627-43c2-b317-22c743dd8f9d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:21 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-49a19e54-a627-43c2-b317-22c743dd8f9d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:21 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-49a19e54-a627-43c2-b317-22c743dd8f9d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:21 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-49a19e54-a627-43c2-b317-22c743dd8f9d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:21 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-49a19e54-a627-43c2-b317-22c743dd8f9d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] HTTP exception thrown: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:41:21 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-49a19e54-a627-43c2-b317-22c743dd8f9d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Request method failure captured: Apr 18 14:41:21 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 HTTP/1.1 Apr 18 14:41:21 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:41:21 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:41:21 user devstack@n-api.service[61309]: Connection: close Apr 18 14:41:21 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:41:21 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:41:21 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:41:21 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:41:21 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqrDabR2U-1ioZsog1d_Oe7stjemJyN965_3QF6lSyU5B3aX0TjwgV2ScEQsf8XtbOQxLYBn1q1tQEMntGIoyvVq5cW3kqQZHF8J8pWejXnqQQvbKTw-fm6UUe-u_HRbu6moOhNBxxZ9yz3p89jNLYmODyaAAvgUGYugBI5gCAN3RRc Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Project-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Project-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Tenant: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Tenant-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:41:21 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:41:21 user devstack@n-api.service[61309]: X-User: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:41:21 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:41:21 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:41:21 user devstack@n-api.service[61309]: X-User-Id: 43dd536529724c41980d5f2fddd8c71d Apr 18 14:41:21 user devstack@n-api.service[61309]: X-User-Name: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:41:21 user devstack@n-api.service[61309]: method: > Apr 18 14:41:21 user devstack@n-api.service[61309]: exception: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:41:21 user devstack@n-api.service[61309]: action_args: {'id': '9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1'} Apr 18 14:41:21 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:41:21 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:41:21 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-49a19e54-a627-43c2-b317-22c743dd8f9d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Returning 404 to user: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:41:21 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-49a19e54-a627-43c2-b317-22c743dd8f9d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1" status: 404 len: 111 microversion: 2.1 time: 0.141026 Apr 18 14:41:21 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 130/385] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:41:20 2023] GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:41:21 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:21 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:21 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-cbc87078-2334-48e1-b12e-94373e86e0d7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '.version_select at 0x7f5cee94f2e0>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:41:21 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-cbc87078-2334-48e1-b12e-94373e86e0d7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-50073693" status: 202 len: 0 microversion: 2.1 time: 0.023640 Apr 18 14:41:21 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 128/386] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 18 14:41:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-50073693 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:41:21 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-1e7226ab-4c23-4840-a23d-add98435f230 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Action: 'create', calling method: .version_select at 0x7f5ceeafa560>, body: {"keypair": {"name": "tempest-keypair-1256067480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaxY9GX1RZFs76STXcb4Z2t04n5krsgK97WeHRuY4IPGH/MDIIGjicOr0oQsToliRdx9/udtqySs4jNTFNyX1XViIZuO4zIfbkckcadLrdEijY9tJfG/wZFzI/ggM/eVg=="}} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:41:21 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-1e7226ab-4c23-4840-a23d-add98435f230 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Getting quotas for project e38cf2921e9c49b98933eb439c2ea431. Resources: {'key_pairs'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:41:21 user devstack@n-api.service[61310]: DEBUG nova.quota [None req-1e7226ab-4c23-4840-a23d-add98435f230 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Getting quotas for user 43dd536529724c41980d5f2fddd8c71d and project e38cf2921e9c49b98933eb439c2ea431. Resources: {'key_pairs'} {{(pid=61310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:41:21 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-1e7226ab-4c23-4840-a23d-add98435f230 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045516 Apr 18 14:41:21 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 129/387] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 14:41:21 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1005215234", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "241eb4cb-7a63-47fa-873a-79cdcab7a582"}], "security_groups": [{"name": "tempest-securitygroup--925002365"}], "key_name": "tempest-keypair-1256067480", "user_data": "}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] validate_networks() for [('241eb4cb-7a63-47fa-873a-79cdcab7a582', None, None, None, None, None)] {{(pid=61309) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Flavor limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Image limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Flavor pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Image pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Getting quotas for project e38cf2921e9c49b98933eb439c2ea431. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Getting quotas for user 43dd536529724c41980d5f2fddd8c71d and project e38cf2921e9c49b98933eb439c2ea431. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Going to run 1 instances... {{(pid=61309) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:41:23 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: b0b435ff-00e9-47c1-880e-a57e55728ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61309) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:41:23 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-03756d9c-2544-4cd5-b66c-197476f6df08 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.795584 Apr 18 14:41:23 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 131/388] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 14:41:23 2023] POST /compute/v2.1/servers => generated 399 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 14:41:24 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-9fbdc8f2-43af-4c8f-80db-172800e2c1ee tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:41:24 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-9fbdc8f2-43af-4c8f-80db-172800e2c1ee tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: b0b435ff-00e9-47c1-880e-a57e55728ddc] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:41:24 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-9fbdc8f2-43af-4c8f-80db-172800e2c1ee tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd536529724c41980d5f2fddd8c71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38cf2921e9c49b98933eb439c2ea431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:41:24 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-9fbdc8f2-43af-4c8f-80db-172800e2c1ee tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc" status: 200 len: 1236 microversion: 2.1 time: 0.065741 Apr 18 14:41:24 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 129/389] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:41:24 2023] GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:41:26 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-3ea946b5-77dc-4048-b7eb-a20454779ae1 req-62e4d17f-1760-4ac7-8dbf-cf43fe3dcf0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b435ff-00e9-47c1-880e-a57e55728ddc", "tag": "91ad47bc-c68b-4554-bdc0-506626c8d6e0"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:41:26 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-3ea946b5-77dc-4048-b7eb-a20454779ae1 req-62e4d17f-1760-4ac7-8dbf-cf43fe3dcf0f service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:26 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-3ea946b5-77dc-4048-b7eb-a20454779ae1 req-62e4d17f-1760-4ac7-8dbf-cf43fe3dcf0f service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:26 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-3ea946b5-77dc-4048-b7eb-a20454779ae1 req-62e4d17f-1760-4ac7-8dbf-cf43fe3dcf0f service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:26 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-3ea946b5-77dc-4048-b7eb-a20454779ae1 req-62e4d17f-1760-4ac7-8dbf-cf43fe3dcf0f service nova] Creating event network-changed:91ad47bc-c68b-4554-bdc0-506626c8d6e0 for instance b0b435ff-00e9-47c1-880e-a57e55728ddc on user Apr 18 14:41:26 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-3ea946b5-77dc-4048-b7eb-a20454779ae1 req-62e4d17f-1760-4ac7-8dbf-cf43fe3dcf0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029993 Apr 18 14:41:26 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 130/390] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:41:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:41:28 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-78d19716-82f1-4221-a9c9-b265a5d5333f req-5d4096ff-3c7c-4275-94dc-ca8258e67331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b435ff-00e9-47c1-880e-a57e55728ddc", "name": "network-vif-plugged", "status": "completed", "tag": "91ad47bc-c68b-4554-bdc0-506626c8d6e0"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:41:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-78d19716-82f1-4221-a9c9-b265a5d5333f req-5d4096ff-3c7c-4275-94dc-ca8258e67331 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-78d19716-82f1-4221-a9c9-b265a5d5333f req-5d4096ff-3c7c-4275-94dc-ca8258e67331 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:28 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-78d19716-82f1-4221-a9c9-b265a5d5333f req-5d4096ff-3c7c-4275-94dc-ca8258e67331 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:28 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-78d19716-82f1-4221-a9c9-b265a5d5333f req-5d4096ff-3c7c-4275-94dc-ca8258e67331 service nova] Creating event network-vif-plugged:91ad47bc-c68b-4554-bdc0-506626c8d6e0 for instance b0b435ff-00e9-47c1-880e-a57e55728ddc on user Apr 18 14:41:28 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-78d19716-82f1-4221-a9c9-b265a5d5333f req-5d4096ff-3c7c-4275-94dc-ca8258e67331 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035904 Apr 18 14:41:28 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 132/391] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:41:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:41:30 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-47c3bd39-5a80-4a07-88ad-f503db031a4a req-2531ea5f-f99a-47c5-9b17-e88af184b896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b435ff-00e9-47c1-880e-a57e55728ddc", "name": "network-vif-plugged", "status": "completed", "tag": "91ad47bc-c68b-4554-bdc0-506626c8d6e0"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:41:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-47c3bd39-5a80-4a07-88ad-f503db031a4a req-2531ea5f-f99a-47c5-9b17-e88af184b896 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-47c3bd39-5a80-4a07-88ad-f503db031a4a req-2531ea5f-f99a-47c5-9b17-e88af184b896 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:30 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-47c3bd39-5a80-4a07-88ad-f503db031a4a req-2531ea5f-f99a-47c5-9b17-e88af184b896 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:30 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-47c3bd39-5a80-4a07-88ad-f503db031a4a req-2531ea5f-f99a-47c5-9b17-e88af184b896 service nova] Creating event network-vif-plugged:91ad47bc-c68b-4554-bdc0-506626c8d6e0 for instance b0b435ff-00e9-47c1-880e-a57e55728ddc on user Apr 18 14:41:30 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-47c3bd39-5a80-4a07-88ad-f503db031a4a req-2531ea5f-f99a-47c5-9b17-e88af184b896 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031241 Apr 18 14:41:30 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 130/392] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:41:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:41:36 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell0:SELECT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:36 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:36 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=8 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:36 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-bfa2b022-bca0-4233-80ed-09bf273d1cdf tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:41:36 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-bfa2b022-bca0-4233-80ed-09bf273d1cdf tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] [instance: 2da160d0-3fc5-43ef-a864-87c2d356643f] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:41:36 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-bfa2b022-bca0-4233-80ed-09bf273d1cdf tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:36 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-bfa2b022-bca0-4233-80ed-09bf273d1cdf tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:36 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-bfa2b022-bca0-4233-80ed-09bf273d1cdf tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:36 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-bfa2b022-bca0-4233-80ed-09bf273d1cdf tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:36 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-bfa2b022-bca0-4233-80ed-09bf273d1cdf tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:36 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-bfa2b022-bca0-4233-80ed-09bf273d1cdf tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:37 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-bfa2b022-bca0-4233-80ed-09bf273d1cdf tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30bc97702e14959b6510ee0b8855cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4668f5858e4246209a2057c984e499dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:41:37 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-bfa2b022-bca0-4233-80ed-09bf273d1cdf tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f" status: 200 len: 1568 microversion: 2.1 time: 0.244250 Apr 18 14:41:37 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 131/393] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:41:36 2023] GET /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-2451d29d-93eb-4fab-82bf-8abb7fdb2797 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-2451d29d-93eb-4fab-82bf-8abb7fdb2797 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] [instance: 2da160d0-3fc5-43ef-a864-87c2d356643f] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2451d29d-93eb-4fab-82bf-8abb7fdb2797 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2451d29d-93eb-4fab-82bf-8abb7fdb2797 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2451d29d-93eb-4fab-82bf-8abb7fdb2797 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2451d29d-93eb-4fab-82bf-8abb7fdb2797 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2451d29d-93eb-4fab-82bf-8abb7fdb2797 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2451d29d-93eb-4fab-82bf-8abb7fdb2797 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:38 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-2451d29d-93eb-4fab-82bf-8abb7fdb2797 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] [instance: 2da160d0-3fc5-43ef-a864-87c2d356643f] Going to try to terminate instance {{(pid=61309) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:41:38 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-2451d29d-93eb-4fab-82bf-8abb7fdb2797 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f" status: 204 len: 0 microversion: 2.1 time: 0.123657 Apr 18 14:41:38 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 133/394] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:41:38 2023] DELETE /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:41:38 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:41:38 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-81317e1a-3f7f-4c7a-bc48-548435f47420 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:41:38 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-81317e1a-3f7f-4c7a-bc48-548435f47420 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] [instance: 2da160d0-3fc5-43ef-a864-87c2d356643f] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:41:38 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-81317e1a-3f7f-4c7a-bc48-548435f47420 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:38 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-81317e1a-3f7f-4c7a-bc48-548435f47420 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:38 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-81317e1a-3f7f-4c7a-bc48-548435f47420 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:38 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-81317e1a-3f7f-4c7a-bc48-548435f47420 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:38 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-81317e1a-3f7f-4c7a-bc48-548435f47420 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:38 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-81317e1a-3f7f-4c7a-bc48-548435f47420 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:39 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-fb2459c5-beb5-45ab-8deb-638d212fa6c1 req-b78b6d22-fc7e-4558-badf-08d2c0573ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da160d0-3fc5-43ef-a864-87c2d356643f", "name": "network-vif-unplugged", "status": "completed", "tag": "461f6e18-0966-48ce-8d02-3fc895ad8887"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:41:39 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-81317e1a-3f7f-4c7a-bc48-548435f47420 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30bc97702e14959b6510ee0b8855cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4668f5858e4246209a2057c984e499dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:41:39 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-fb2459c5-beb5-45ab-8deb-638d212fa6c1 req-b78b6d22-fc7e-4558-badf-08d2c0573ff5 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:39 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-fb2459c5-beb5-45ab-8deb-638d212fa6c1 req-b78b6d22-fc7e-4558-badf-08d2c0573ff5 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:39 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-fb2459c5-beb5-45ab-8deb-638d212fa6c1 req-b78b6d22-fc7e-4558-badf-08d2c0573ff5 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:39 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-81317e1a-3f7f-4c7a-bc48-548435f47420 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f" status: 200 len: 1574 microversion: 2.1 time: 0.263075 Apr 18 14:41:39 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 131/395] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:41:38 2023] GET /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f => generated 1574 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:41:39 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-fb2459c5-beb5-45ab-8deb-638d212fa6c1 req-b78b6d22-fc7e-4558-badf-08d2c0573ff5 service nova] Creating event network-vif-unplugged:461f6e18-0966-48ce-8d02-3fc895ad8887 for instance 2da160d0-3fc5-43ef-a864-87c2d356643f on user Apr 18 14:41:39 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-fb2459c5-beb5-45ab-8deb-638d212fa6c1 req-b78b6d22-fc7e-4558-badf-08d2c0573ff5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029328 Apr 18 14:41:39 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 132/396] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:41:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:41:41 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-4039b624-f4a1-483e-b11d-93ddd7c653b6 req-8ada6820-bbbf-46d4-a53a-a468ebb4ac14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da160d0-3fc5-43ef-a864-87c2d356643f", "name": "network-vif-plugged", "status": "completed", "tag": "461f6e18-0966-48ce-8d02-3fc895ad8887"}, {"server_uuid": "2da160d0-3fc5-43ef-a864-87c2d356643f", "name": "network-vif-deleted", "tag": "461f6e18-0966-48ce-8d02-3fc895ad8887"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:41:41 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-4039b624-f4a1-483e-b11d-93ddd7c653b6 req-8ada6820-bbbf-46d4-a53a-a468ebb4ac14 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:41 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-4039b624-f4a1-483e-b11d-93ddd7c653b6 req-8ada6820-bbbf-46d4-a53a-a468ebb4ac14 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:41 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-4039b624-f4a1-483e-b11d-93ddd7c653b6 req-8ada6820-bbbf-46d4-a53a-a468ebb4ac14 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:41 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-4039b624-f4a1-483e-b11d-93ddd7c653b6 req-8ada6820-bbbf-46d4-a53a-a468ebb4ac14 service nova] Creating event network-vif-plugged:461f6e18-0966-48ce-8d02-3fc895ad8887 for instance 2da160d0-3fc5-43ef-a864-87c2d356643f on user Apr 18 14:41:41 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-4039b624-f4a1-483e-b11d-93ddd7c653b6 req-8ada6820-bbbf-46d4-a53a-a468ebb4ac14 service nova] Creating event network-vif-deleted:461f6e18-0966-48ce-8d02-3fc895ad8887 for instance 2da160d0-3fc5-43ef-a864-87c2d356643f on user Apr 18 14:41:41 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-4039b624-f4a1-483e-b11d-93ddd7c653b6 req-8ada6820-bbbf-46d4-a53a-a468ebb4ac14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031417 Apr 18 14:41:41 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 134/397] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:41:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:41:42 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-bfea8fb8-0f51-4025-81ac-f94a0f81c442 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:41:42 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-bfea8fb8-0f51-4025-81ac-f94a0f81c442 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: 47d56c29-010e-48a8-a1c6-8c62decfd02d] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:41:42 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-bfea8fb8-0f51-4025-81ac-f94a0f81c442 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:42 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-bfea8fb8-0f51-4025-81ac-f94a0f81c442 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:42 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-bfea8fb8-0f51-4025-81ac-f94a0f81c442 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:42 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-bfea8fb8-0f51-4025-81ac-f94a0f81c442 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:41:42 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-bfea8fb8-0f51-4025-81ac-f94a0f81c442 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:41:42 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-bfea8fb8-0f51-4025-81ac-f94a0f81c442 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:41:42 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-bfea8fb8-0f51-4025-81ac-f94a0f81c442 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:41:42 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-bfea8fb8-0f51-4025-81ac-f94a0f81c442 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:41:42 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-bfea8fb8-0f51-4025-81ac-f94a0f81c442 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:41:42 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-bfea8fb8-0f51-4025-81ac-f94a0f81c442 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d" status: 200 len: 1587 microversion: 2.20 time: 0.211252 Apr 18 14:41:42 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 132/398] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:41:42 2023] GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d => generated 1587 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:42:14 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:14 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=8 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:14 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-caa2687e-b10b-49f8-b9d7-3dbbb07e0803 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:42:14 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-caa2687e-b10b-49f8-b9d7-3dbbb07e0803 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: b0b435ff-00e9-47c1-880e-a57e55728ddc] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:42:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-caa2687e-b10b-49f8-b9d7-3dbbb07e0803 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-caa2687e-b10b-49f8-b9d7-3dbbb07e0803 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-caa2687e-b10b-49f8-b9d7-3dbbb07e0803 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-caa2687e-b10b-49f8-b9d7-3dbbb07e0803 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-caa2687e-b10b-49f8-b9d7-3dbbb07e0803 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:14 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-caa2687e-b10b-49f8-b9d7-3dbbb07e0803 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:14 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-caa2687e-b10b-49f8-b9d7-3dbbb07e0803 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd536529724c41980d5f2fddd8c71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38cf2921e9c49b98933eb439c2ea431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:42:14 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-caa2687e-b10b-49f8-b9d7-3dbbb07e0803 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc" status: 200 len: 1545 microversion: 2.1 time: 0.255325 Apr 18 14:42:14 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 133/399] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:42:14 2023] GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc => generated 1545 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:42:16 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:16 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:16 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1229612261", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "8edeafd7-9a4e-4c72-b1e3-a40f1a6e70aa"}]}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:42:16 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] validate_networks() for [('8edeafd7-9a4e-4c72-b1e3-a40f1a6e70aa', None, None, None, None, None)] {{(pid=61309) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Flavor limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Image limits 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Flavor pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Image pref 0:0:0 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG nova.virt.hardware [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61309) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Getting quotas for project f1bb3c50254545ff88c6bb55ccd16e7c. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG nova.quota [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Getting quotas for user bf32806393ed4030970e1a6e445bc43d and project f1bb3c50254545ff88c6bb55ccd16e7c. Resources: {'cores', 'ram', 'instances'} {{(pid=61309) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Going to run 1 instances... {{(pid=61309) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:42:17 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61309) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:42:17 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-41e6c8a9-5ac6-4755-b9b2-9884fdd99111 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.746100 Apr 18 14:42:17 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 135/400] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 14:42:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 14:42:17 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-e0b75e31-cb47-403f-b132-76780ebec770 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:42:17 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-e0b75e31-cb47-403f-b132-76780ebec770 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:42:17 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:17 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=14 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:17 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-e0b75e31-cb47-403f-b132-76780ebec770 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:42:17 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-e0b75e31-cb47-403f-b132-76780ebec770 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:42:17 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-e0b75e31-cb47-403f-b132-76780ebec770 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:42:17 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-e0b75e31-cb47-403f-b132-76780ebec770 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/030b1fc9-60bc-46c9-92e1-39fcce32c52e" status: 200 len: 1395 microversion: 2.87 time: 0.129944 Apr 18 14:42:17 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 133/401] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:42:17 2023] GET /compute/v2.1/servers/030b1fc9-60bc-46c9-92e1-39fcce32c52e => generated 1395 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:42:20 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-47fcc2b9-8f79-408c-b917-0948c6d0d76f req-6a63e7dd-8ed6-49a1-b3f9-6a98ad210521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "030b1fc9-60bc-46c9-92e1-39fcce32c52e", "tag": "a1ddea90-7d0a-49cf-9ec9-e5239b0f57fc"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:42:20 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-47fcc2b9-8f79-408c-b917-0948c6d0d76f req-6a63e7dd-8ed6-49a1-b3f9-6a98ad210521 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:20 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-47fcc2b9-8f79-408c-b917-0948c6d0d76f req-6a63e7dd-8ed6-49a1-b3f9-6a98ad210521 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:20 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-47fcc2b9-8f79-408c-b917-0948c6d0d76f req-6a63e7dd-8ed6-49a1-b3f9-6a98ad210521 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:20 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-47fcc2b9-8f79-408c-b917-0948c6d0d76f req-6a63e7dd-8ed6-49a1-b3f9-6a98ad210521 service nova] Creating event network-changed:a1ddea90-7d0a-49cf-9ec9-e5239b0f57fc for instance 030b1fc9-60bc-46c9-92e1-39fcce32c52e on user Apr 18 14:42:20 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-47fcc2b9-8f79-408c-b917-0948c6d0d76f req-6a63e7dd-8ed6-49a1-b3f9-6a98ad210521 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056323 Apr 18 14:42:20 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 134/402] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:42:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:42:21 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-4b2bf963-d2bd-4478-9270-876b6cafa62f req-dae5adf3-c403-4edb-9fef-e3d9933cf04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030b1fc9-60bc-46c9-92e1-39fcce32c52e", "name": "network-vif-deleted", "tag": "a1ddea90-7d0a-49cf-9ec9-e5239b0f57fc"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:42:21 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-4b2bf963-d2bd-4478-9270-876b6cafa62f req-dae5adf3-c403-4edb-9fef-e3d9933cf04c service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:21 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-4b2bf963-d2bd-4478-9270-876b6cafa62f req-dae5adf3-c403-4edb-9fef-e3d9933cf04c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:21 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-4b2bf963-d2bd-4478-9270-876b6cafa62f req-dae5adf3-c403-4edb-9fef-e3d9933cf04c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:21 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.compute.server_external_events [req-4b2bf963-d2bd-4478-9270-876b6cafa62f req-dae5adf3-c403-4edb-9fef-e3d9933cf04c service nova] Unable to find a host for instance 030b1fc9-60bc-46c9-92e1-39fcce32c52e. Dropping event network-vif-deleted {{(pid=61309) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 14:42:21 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-4b2bf963-d2bd-4478-9270-876b6cafa62f req-dae5adf3-c403-4edb-9fef-e3d9933cf04c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031278 Apr 18 14:42:21 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 136/403] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:42:21 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 14:42:29 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-7280a648-6d4a-4f06-bceb-0f57c7a88c61 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:42:29 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-7280a648-6d4a-4f06-bceb-0f57c7a88c61 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] [instance: 2da160d0-3fc5-43ef-a864-87c2d356643f] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:42:29 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:29 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-7280a648-6d4a-4f06-bceb-0f57c7a88c61 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-7280a648-6d4a-4f06-bceb-0f57c7a88c61 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-7280a648-6d4a-4f06-bceb-0f57c7a88c61 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-7280a648-6d4a-4f06-bceb-0f57c7a88c61 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-7280a648-6d4a-4f06-bceb-0f57c7a88c61 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:29 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-7280a648-6d4a-4f06-bceb-0f57c7a88c61 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:29 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-7280a648-6d4a-4f06-bceb-0f57c7a88c61 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] HTTP exception thrown: Instance 2da160d0-3fc5-43ef-a864-87c2d356643f could not be found. Apr 18 14:42:29 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-7280a648-6d4a-4f06-bceb-0f57c7a88c61 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Request method failure captured: Apr 18 14:42:29 user devstack@n-api.service[61311]: request: GET /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f HTTP/1.1 Apr 18 14:42:29 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:42:29 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:42:29 user devstack@n-api.service[61311]: Connection: close Apr 18 14:42:29 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:42:29 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:42:29 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:42:29 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:42:29 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqunZkRZtuO4qRELuDqDE7iK1QkdyKhCUY9UkF7pc3RF3fENzzamBBJXRasarYZkVMlV1Bbhg5ecHeE9j1gqHaIAPlXm7Qx3gM6xY0iKL4bfZwWe3vPpFepdaRJ3z9XsETFXQCLMhL92s1z9z0Ah-LoXohnifUNTaF8_yXgRJtMf81w Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Project-Id: 4668f5858e4246209a2057c984e499dc Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Project-Name: tempest-SnapshotDataIntegrityTests-827394539 Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4668f5858e4246209a2057c984e499dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4668f5858e4246209a2057c984e499dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4668f5858e4246209a2057c984e499dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Tenant: tempest-SnapshotDataIntegrityTests-827394539 Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Tenant-Id: 4668f5858e4246209a2057c984e499dc Apr 18 14:42:29 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-827394539 Apr 18 14:42:29 user devstack@n-api.service[61311]: X-User: tempest-SnapshotDataIntegrityTests-827394539-project-member Apr 18 14:42:29 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:42:29 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:42:29 user devstack@n-api.service[61311]: X-User-Id: f30bc97702e14959b6510ee0b8855cac Apr 18 14:42:29 user devstack@n-api.service[61311]: X-User-Name: tempest-SnapshotDataIntegrityTests-827394539-project-member Apr 18 14:42:29 user devstack@n-api.service[61311]: method: > Apr 18 14:42:29 user devstack@n-api.service[61311]: exception: Instance 2da160d0-3fc5-43ef-a864-87c2d356643f could not be found. Apr 18 14:42:29 user devstack@n-api.service[61311]: action_args: {'id': '2da160d0-3fc5-43ef-a864-87c2d356643f'} Apr 18 14:42:29 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2da160d0-3fc5-43ef-a864-87c2d356643f could not be found. Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2da160d0-3fc5-43ef-a864-87c2d356643f could not be found. Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2da160d0-3fc5-43ef-a864-87c2d356643f could not be found. Apr 18 14:42:29 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:42:29 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-7280a648-6d4a-4f06-bceb-0f57c7a88c61 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Returning 404 to user: Instance 2da160d0-3fc5-43ef-a864-87c2d356643f could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:42:29 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-7280a648-6d4a-4f06-bceb-0f57c7a88c61 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f" status: 404 len: 111 microversion: 2.1 time: 0.032832 Apr 18 14:42:29 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 134/404] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:42:29 2023] GET /compute/v2.1/servers/2da160d0-3fc5-43ef-a864-87c2d356643f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:42:29 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-9792ee5e-b518-438b-a8d7-590ae5fb6bf0 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] Calling method '.version_select at 0x7f5ceeafa830>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:42:29 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-9792ee5e-b518-438b-a8d7-590ae5fb6bf0 tempest-SnapshotDataIntegrityTests-827394539 tempest-SnapshotDataIntegrityTests-827394539-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-358630619" status: 202 len: 0 microversion: 2.1 time: 0.025796 Apr 18 14:42:29 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 135/405] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 14:42:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-358630619 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:42:42 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-f44855a8-1b84-4a57-bf04-8a7a9fc39590 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:42:42 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-f44855a8-1b84-4a57-bf04-8a7a9fc39590 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: 47d56c29-010e-48a8-a1c6-8c62decfd02d] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:42:42 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:42 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:42 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:42 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=4 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f44855a8-1b84-4a57-bf04-8a7a9fc39590 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f44855a8-1b84-4a57-bf04-8a7a9fc39590 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f44855a8-1b84-4a57-bf04-8a7a9fc39590 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f44855a8-1b84-4a57-bf04-8a7a9fc39590 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f44855a8-1b84-4a57-bf04-8a7a9fc39590 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:42 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-f44855a8-1b84-4a57-bf04-8a7a9fc39590 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:42 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-f44855a8-1b84-4a57-bf04-8a7a9fc39590 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.164563 Apr 18 14:42:42 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 137/406] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 14:42:42 2023] GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d/os-interface => generated 282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 14:42:43 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-4f0d173e-8b5e-426d-acfe-24879a2ca66f req-8846c5d3-5dd7-47ef-b521-bedbfed96ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47d56c29-010e-48a8-a1c6-8c62decfd02d", "tag": "ac9004e4-83b8-4351-811a-b5d6a384cb3c"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:42:43 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:43 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:43 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-4f0d173e-8b5e-426d-acfe-24879a2ca66f req-8846c5d3-5dd7-47ef-b521-bedbfed96ec5 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:43 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-4f0d173e-8b5e-426d-acfe-24879a2ca66f req-8846c5d3-5dd7-47ef-b521-bedbfed96ec5 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:43 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-4f0d173e-8b5e-426d-acfe-24879a2ca66f req-8846c5d3-5dd7-47ef-b521-bedbfed96ec5 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:43 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-4f0d173e-8b5e-426d-acfe-24879a2ca66f req-8846c5d3-5dd7-47ef-b521-bedbfed96ec5 service nova] Creating event network-changed:ac9004e4-83b8-4351-811a-b5d6a384cb3c for instance 47d56c29-010e-48a8-a1c6-8c62decfd02d on user Apr 18 14:42:43 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-4f0d173e-8b5e-426d-acfe-24879a2ca66f req-8846c5d3-5dd7-47ef-b521-bedbfed96ec5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040709 Apr 18 14:42:43 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 135/407] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:42:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:42:44 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=8 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:44 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:42:44 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-3a57fc4e-eee7-4027-9a3e-1c0875526b44 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:42:44 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-3a57fc4e-eee7-4027-9a3e-1c0875526b44 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: 47d56c29-010e-48a8-a1c6-8c62decfd02d] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:42:44 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3a57fc4e-eee7-4027-9a3e-1c0875526b44 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:44 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3a57fc4e-eee7-4027-9a3e-1c0875526b44 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:44 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3a57fc4e-eee7-4027-9a3e-1c0875526b44 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:44 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3a57fc4e-eee7-4027-9a3e-1c0875526b44 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:44 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3a57fc4e-eee7-4027-9a3e-1c0875526b44 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:44 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-3a57fc4e-eee7-4027-9a3e-1c0875526b44 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:44 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-3a57fc4e-eee7-4027-9a3e-1c0875526b44 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d/ips" status: 200 len: 150 microversion: 2.20 time: 0.043118 Apr 18 14:42:44 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 136/408] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 14:42:44 2023] GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 18 14:42:45 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-d00c97dc-f379-497f-8934-e51805597d5d tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:42:45 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-d00c97dc-f379-497f-8934-e51805597d5d tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: 47d56c29-010e-48a8-a1c6-8c62decfd02d] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:42:45 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d00c97dc-f379-497f-8934-e51805597d5d tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:45 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d00c97dc-f379-497f-8934-e51805597d5d tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:45 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d00c97dc-f379-497f-8934-e51805597d5d tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:45 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d00c97dc-f379-497f-8934-e51805597d5d tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:45 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d00c97dc-f379-497f-8934-e51805597d5d tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:45 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d00c97dc-f379-497f-8934-e51805597d5d tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:46 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-d00c97dc-f379-497f-8934-e51805597d5d tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: 47d56c29-010e-48a8-a1c6-8c62decfd02d] Going to try to terminate instance {{(pid=61309) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:42:46 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-d00c97dc-f379-497f-8934-e51805597d5d tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d" status: 204 len: 0 microversion: 2.20 time: 0.107656 Apr 18 14:42:46 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 138/409] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 14:42:45 2023] DELETE /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 14:42:46 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-cfa5afe9-9d52-4cbb-a3ae-f2e9ae63242e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:42:46 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-cfa5afe9-9d52-4cbb-a3ae-f2e9ae63242e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: 47d56c29-010e-48a8-a1c6-8c62decfd02d] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:42:46 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cfa5afe9-9d52-4cbb-a3ae-f2e9ae63242e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:46 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cfa5afe9-9d52-4cbb-a3ae-f2e9ae63242e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:46 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cfa5afe9-9d52-4cbb-a3ae-f2e9ae63242e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:46 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cfa5afe9-9d52-4cbb-a3ae-f2e9ae63242e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:46 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cfa5afe9-9d52-4cbb-a3ae-f2e9ae63242e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:46 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-cfa5afe9-9d52-4cbb-a3ae-f2e9ae63242e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:46 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-d9873f04-d6b4-4526-bb37-969b23ce6d1b req-1aa92df1-6815-4f96-9fa0-f93c1bc74090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d56c29-010e-48a8-a1c6-8c62decfd02d", "name": "network-vif-unplugged", "status": "completed", "tag": "ac9004e4-83b8-4351-811a-b5d6a384cb3c"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:42:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-d9873f04-d6b4-4526-bb37-969b23ce6d1b req-1aa92df1-6815-4f96-9fa0-f93c1bc74090 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-d9873f04-d6b4-4526-bb37-969b23ce6d1b req-1aa92df1-6815-4f96-9fa0-f93c1bc74090 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:46 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-d9873f04-d6b4-4526-bb37-969b23ce6d1b req-1aa92df1-6815-4f96-9fa0-f93c1bc74090 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:46 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-d9873f04-d6b4-4526-bb37-969b23ce6d1b req-1aa92df1-6815-4f96-9fa0-f93c1bc74090 service nova] Creating event network-vif-unplugged:ac9004e4-83b8-4351-811a-b5d6a384cb3c for instance 47d56c29-010e-48a8-a1c6-8c62decfd02d on user Apr 18 14:42:46 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-d9873f04-d6b4-4526-bb37-969b23ce6d1b req-1aa92df1-6815-4f96-9fa0-f93c1bc74090 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028551 Apr 18 14:42:46 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 137/410] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:42:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:42:46 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-cfa5afe9-9d52-4cbb-a3ae-f2e9ae63242e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:42:46 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-cfa5afe9-9d52-4cbb-a3ae-f2e9ae63242e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:42:46 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-cfa5afe9-9d52-4cbb-a3ae-f2e9ae63242e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b4ce9342145403c9ba6a9871fbf490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3549c53be65e4fc2a2bb124109319ca2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:42:46 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-cfa5afe9-9d52-4cbb-a3ae-f2e9ae63242e tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d" status: 200 len: 1712 microversion: 2.20 time: 0.366271 Apr 18 14:42:46 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 136/411] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:42:46 2023] GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d => generated 1712 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:42:47 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-7ba11b8e-5bc4-4a67-99ca-fb923aa0dfe7 req-162ec24f-a2ee-4c6d-b228-aa56052e0e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d56c29-010e-48a8-a1c6-8c62decfd02d", "name": "network-vif-deleted", "tag": "ac9004e4-83b8-4351-811a-b5d6a384cb3c"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:42:47 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-7ba11b8e-5bc4-4a67-99ca-fb923aa0dfe7 req-162ec24f-a2ee-4c6d-b228-aa56052e0e83 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:47 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-7ba11b8e-5bc4-4a67-99ca-fb923aa0dfe7 req-162ec24f-a2ee-4c6d-b228-aa56052e0e83 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:47 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-7ba11b8e-5bc4-4a67-99ca-fb923aa0dfe7 req-162ec24f-a2ee-4c6d-b228-aa56052e0e83 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:47 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-7ba11b8e-5bc4-4a67-99ca-fb923aa0dfe7 req-162ec24f-a2ee-4c6d-b228-aa56052e0e83 service nova] Creating event network-vif-deleted:ac9004e4-83b8-4351-811a-b5d6a384cb3c for instance 47d56c29-010e-48a8-a1c6-8c62decfd02d on user Apr 18 14:42:47 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-7ba11b8e-5bc4-4a67-99ca-fb923aa0dfe7 req-162ec24f-a2ee-4c6d-b228-aa56052e0e83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034107 Apr 18 14:42:47 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 139/412] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:42:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:42:48 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-69673c01-b486-470a-afc3-11a1764d061b req-65b9db69-e7d4-43d7-bf26-19a618c198f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47d56c29-010e-48a8-a1c6-8c62decfd02d", "name": "network-vif-plugged", "status": "completed", "tag": "ac9004e4-83b8-4351-811a-b5d6a384cb3c"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:42:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-69673c01-b486-470a-afc3-11a1764d061b req-65b9db69-e7d4-43d7-bf26-19a618c198f6 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:42:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-69673c01-b486-470a-afc3-11a1764d061b req-65b9db69-e7d4-43d7-bf26-19a618c198f6 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:42:48 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-69673c01-b486-470a-afc3-11a1764d061b req-65b9db69-e7d4-43d7-bf26-19a618c198f6 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:42:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-69673c01-b486-470a-afc3-11a1764d061b req-65b9db69-e7d4-43d7-bf26-19a618c198f6 service nova] Creating event network-vif-plugged:ac9004e4-83b8-4351-811a-b5d6a384cb3c for instance 47d56c29-010e-48a8-a1c6-8c62decfd02d on user Apr 18 14:42:48 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-69673c01-b486-470a-afc3-11a1764d061b req-65b9db69-e7d4-43d7-bf26-19a618c198f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028774 Apr 18 14:42:48 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 138/413] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:42:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=8 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG nova.objects.instance [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lazy-loading 'fault' on Instance uuid 030b1fc9-60bc-46c9-92e1-39fcce32c52e {{(pid=61311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:43:07 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:43:07 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-dee582cb-eea3-4a45-956b-363abfe9d1fb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/030b1fc9-60bc-46c9-92e1-39fcce32c52e" status: 200 len: 1650 microversion: 2.87 time: 0.181728 Apr 18 14:43:07 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 137/414] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:43:07 2023] GET /compute/v2.1/servers/030b1fc9-60bc-46c9-92e1-39fcce32c52e => generated 1650 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] Going to try to terminate instance {{(pid=61309) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] Doing local delete in cell 337bb0b3-02d6-4a06-882a-72d8b3d786a4(cell1) {{(pid=61309) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:07 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:07 user devstack@n-api.service[61309]: WARNING nova.compute.api [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] instance's host None is down, deleting from database Apr 18 14:43:08 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] deallocate_for_instance() {{(pid=61309) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 14:43:08 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] Instance cache missing network info. {{(pid=61309) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 14:43:08 user devstack@n-api.service[61309]: DEBUG nova.network.neutron [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] Updating instance_info_cache with network_info: [] {{(pid=61309) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 14:43:08 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61309) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 14:43:08 user devstack@n-api.service[61309]: WARNING nova.compute.api [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 14:43:08 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-66524502-51b1-4b3f-8f9a-03dad7bbb31f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/030b1fc9-60bc-46c9-92e1-39fcce32c52e" status: 204 len: 0 microversion: 2.87 time: 0.504721 Apr 18 14:43:08 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 140/415] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 14:43:07 2023] DELETE /compute/v2.1/servers/030b1fc9-60bc-46c9-92e1-39fcce32c52e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 14:43:08 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:08 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=8 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-f7cd7530-d73a-4545-ab33-a2fa3ed33b35 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:08 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-f7cd7530-d73a-4545-ab33-a2fa3ed33b35 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 030b1fc9-60bc-46c9-92e1-39fcce32c52e] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-f7cd7530-d73a-4545-ab33-a2fa3ed33b35 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-f7cd7530-d73a-4545-ab33-a2fa3ed33b35 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-f7cd7530-d73a-4545-ab33-a2fa3ed33b35 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-f7cd7530-d73a-4545-ab33-a2fa3ed33b35 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-f7cd7530-d73a-4545-ab33-a2fa3ed33b35 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-f7cd7530-d73a-4545-ab33-a2fa3ed33b35 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:08 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-f7cd7530-d73a-4545-ab33-a2fa3ed33b35 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] HTTP exception thrown: Instance 030b1fc9-60bc-46c9-92e1-39fcce32c52e could not be found. Apr 18 14:43:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-f7cd7530-d73a-4545-ab33-a2fa3ed33b35 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Request method failure captured: Apr 18 14:43:08 user devstack@n-api.service[61310]: request: GET /compute/v2.1/servers/030b1fc9-60bc-46c9-92e1-39fcce32c52e HTTP/1.1 Apr 18 14:43:08 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:43:08 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:43:08 user devstack@n-api.service[61310]: Connection: close Apr 18 14:43:08 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:43:08 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:43:08 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:43:08 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:43:08 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPquWKJBvwso4M8w_PrqFgWouKYzz98R_LdX8iNdfa-iE9UJYFZIUWX8D4yRZEVrXAeROwACDgbqMjS3DBWh518wJ3jucUKcsFu0x9ga9izvkEDvu1FvHyddvDvcXD-wa5I2LNTlPtGx0_nvmO8Y9FBYlt7eOaM2bokgvbkwt_EgFHfc Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Project-Id: f1bb3c50254545ff88c6bb55ccd16e7c Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-727141871 Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1bb3c50254545ff88c6bb55ccd16e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1bb3c50254545ff88c6bb55ccd16e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1bb3c50254545ff88c6bb55ccd16e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-727141871 Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Tenant-Id: f1bb3c50254545ff88c6bb55ccd16e7c Apr 18 14:43:08 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-727141871 Apr 18 14:43:08 user devstack@n-api.service[61310]: X-User: tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member Apr 18 14:43:08 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:43:08 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:43:08 user devstack@n-api.service[61310]: X-User-Id: bf32806393ed4030970e1a6e445bc43d Apr 18 14:43:08 user devstack@n-api.service[61310]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member Apr 18 14:43:08 user devstack@n-api.service[61310]: method: > Apr 18 14:43:08 user devstack@n-api.service[61310]: exception: Instance 030b1fc9-60bc-46c9-92e1-39fcce32c52e could not be found. Apr 18 14:43:08 user devstack@n-api.service[61310]: action_args: {'id': '030b1fc9-60bc-46c9-92e1-39fcce32c52e'} Apr 18 14:43:08 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 030b1fc9-60bc-46c9-92e1-39fcce32c52e could not be found. Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 030b1fc9-60bc-46c9-92e1-39fcce32c52e could not be found. Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 030b1fc9-60bc-46c9-92e1-39fcce32c52e could not be found. Apr 18 14:43:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:43:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-f7cd7530-d73a-4545-ab33-a2fa3ed33b35 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Returning 404 to user: Instance 030b1fc9-60bc-46c9-92e1-39fcce32c52e could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:43:08 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-f7cd7530-d73a-4545-ab33-a2fa3ed33b35 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/030b1fc9-60bc-46c9-92e1-39fcce32c52e" status: 404 len: 111 microversion: 2.87 time: 0.041498 Apr 18 14:43:08 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 139/416] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:43:08 2023] GET /compute/v2.1/servers/030b1fc9-60bc-46c9-92e1-39fcce32c52e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 14:43:08 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2105929052", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "networks": [{"uuid": "8edeafd7-9a4e-4c72-b1e3-a40f1a6e70aa"}]}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:43:08 user devstack@n-api.service[61311]: DEBUG nova.network.neutron [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] validate_networks() for [('8edeafd7-9a4e-4c72-b1e3-a40f1a6e70aa', None, None, None, None, None)] {{(pid=61311) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Flavor limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Image limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Flavor pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Image pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Getting quotas for project f1bb3c50254545ff88c6bb55ccd16e7c. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Getting quotas for user bf32806393ed4030970e1a6e445bc43d and project f1bb3c50254545ff88c6bb55ccd16e7c. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Going to run 1 instances... {{(pid=61311) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:43:09 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 7f3425ec-c7ad-4443-8979-00c95f4b0446] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:43:09 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-383fbb75-f4b8-4906-af4a-8d806df5ad3c tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.959011 Apr 18 14:43:09 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 138/417] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 14:43:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 14:43:09 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-0707d36e-35b8-4fae-a833-c0c1efcdb349 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:09 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-0707d36e-35b8-4fae-a833-c0c1efcdb349 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 7f3425ec-c7ad-4443-8979-00c95f4b0446] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:09 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-0707d36e-35b8-4fae-a833-c0c1efcdb349 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:43:09 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-0707d36e-35b8-4fae-a833-c0c1efcdb349 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:43:09 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-0707d36e-35b8-4fae-a833-c0c1efcdb349 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:43:09 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-0707d36e-35b8-4fae-a833-c0c1efcdb349 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446" status: 200 len: 1395 microversion: 2.87 time: 0.067241 Apr 18 14:43:09 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 141/418] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:43:09 2023] GET /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446 => generated 1395 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:43:11 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-f04dc699-9632-4986-8d79-74af94a6af63 req-6785b6ba-a4ff-4c96-82a9-84c221f6458d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f3425ec-c7ad-4443-8979-00c95f4b0446", "tag": "50fa780a-0fba-4298-932c-ce424fb89844"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:43:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-f04dc699-9632-4986-8d79-74af94a6af63 req-6785b6ba-a4ff-4c96-82a9-84c221f6458d service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-f04dc699-9632-4986-8d79-74af94a6af63 req-6785b6ba-a4ff-4c96-82a9-84c221f6458d service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:11 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-f04dc699-9632-4986-8d79-74af94a6af63 req-6785b6ba-a4ff-4c96-82a9-84c221f6458d service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:11 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-f04dc699-9632-4986-8d79-74af94a6af63 req-6785b6ba-a4ff-4c96-82a9-84c221f6458d service nova] Creating event network-changed:50fa780a-0fba-4298-932c-ce424fb89844 for instance 7f3425ec-c7ad-4443-8979-00c95f4b0446 on user Apr 18 14:43:11 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-f04dc699-9632-4986-8d79-74af94a6af63 req-6785b6ba-a4ff-4c96-82a9-84c221f6458d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031291 Apr 18 14:43:11 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 140/419] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:43:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:43:14 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-09433d8d-0a04-42fd-96fa-9d3e2efbc2fd req-58c793ba-bef4-4465-b0e4-b424620a0d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f3425ec-c7ad-4443-8979-00c95f4b0446", "name": "network-vif-plugged", "status": "completed", "tag": "50fa780a-0fba-4298-932c-ce424fb89844"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:43:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-09433d8d-0a04-42fd-96fa-9d3e2efbc2fd req-58c793ba-bef4-4465-b0e4-b424620a0d3c service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-09433d8d-0a04-42fd-96fa-9d3e2efbc2fd req-58c793ba-bef4-4465-b0e4-b424620a0d3c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:14 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-09433d8d-0a04-42fd-96fa-9d3e2efbc2fd req-58c793ba-bef4-4465-b0e4-b424620a0d3c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:14 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-09433d8d-0a04-42fd-96fa-9d3e2efbc2fd req-58c793ba-bef4-4465-b0e4-b424620a0d3c service nova] Creating event network-vif-plugged:50fa780a-0fba-4298-932c-ce424fb89844 for instance 7f3425ec-c7ad-4443-8979-00c95f4b0446 on user Apr 18 14:43:14 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-09433d8d-0a04-42fd-96fa-9d3e2efbc2fd req-58c793ba-bef4-4465-b0e4-b424620a0d3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033355 Apr 18 14:43:14 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 139/420] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:43:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:43:14 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-879c6aab-774a-46e6-9833-e5ecfb293e8d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:14 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-879c6aab-774a-46e6-9833-e5ecfb293e8d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: b0b435ff-00e9-47c1-880e-a57e55728ddc] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:14 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-879c6aab-774a-46e6-9833-e5ecfb293e8d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:14 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-879c6aab-774a-46e6-9833-e5ecfb293e8d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:14 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-879c6aab-774a-46e6-9833-e5ecfb293e8d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:14 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-879c6aab-774a-46e6-9833-e5ecfb293e8d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:14 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-879c6aab-774a-46e6-9833-e5ecfb293e8d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:14 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-879c6aab-774a-46e6-9833-e5ecfb293e8d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:14 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-879c6aab-774a-46e6-9833-e5ecfb293e8d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.155259 Apr 18 14:43:14 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 142/421] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 14:43:14 2023] GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc/os-interface => generated 282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:43:15 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-b2769b83-7f62-4d11-a6f1-0c35b691688b req-2669eac7-5bba-4b16-8b9c-48ab3b172c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b435ff-00e9-47c1-880e-a57e55728ddc", "tag": "91ad47bc-c68b-4554-bdc0-506626c8d6e0"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:43:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-b2769b83-7f62-4d11-a6f1-0c35b691688b req-2669eac7-5bba-4b16-8b9c-48ab3b172c4f service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-b2769b83-7f62-4d11-a6f1-0c35b691688b req-2669eac7-5bba-4b16-8b9c-48ab3b172c4f service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:15 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-b2769b83-7f62-4d11-a6f1-0c35b691688b req-2669eac7-5bba-4b16-8b9c-48ab3b172c4f service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:15 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-b2769b83-7f62-4d11-a6f1-0c35b691688b req-2669eac7-5bba-4b16-8b9c-48ab3b172c4f service nova] Creating event network-changed:91ad47bc-c68b-4554-bdc0-506626c8d6e0 for instance b0b435ff-00e9-47c1-880e-a57e55728ddc on user Apr 18 14:43:15 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-b2769b83-7f62-4d11-a6f1-0c35b691688b req-2669eac7-5bba-4b16-8b9c-48ab3b172c4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034578 Apr 18 14:43:15 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 141/422] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:43:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:43:15 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-e3561d5b-714a-4ced-aaf4-cf1071bcc0c2 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:15 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-e3561d5b-714a-4ced-aaf4-cf1071bcc0c2 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: b0b435ff-00e9-47c1-880e-a57e55728ddc] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e3561d5b-714a-4ced-aaf4-cf1071bcc0c2 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e3561d5b-714a-4ced-aaf4-cf1071bcc0c2 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e3561d5b-714a-4ced-aaf4-cf1071bcc0c2 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e3561d5b-714a-4ced-aaf4-cf1071bcc0c2 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e3561d5b-714a-4ced-aaf4-cf1071bcc0c2 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-e3561d5b-714a-4ced-aaf4-cf1071bcc0c2 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:15 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-e3561d5b-714a-4ced-aaf4-cf1071bcc0c2 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc/ips" status: 200 len: 108 microversion: 2.1 time: 0.041278 Apr 18 14:43:15 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 140/423] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 14:43:15 2023] GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc/ips => generated 108 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:43:16 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-7ab65df9-4272-4df0-a13d-2794c945883c req-075576bb-c447-4a25-82f9-f9454e46ffe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f3425ec-c7ad-4443-8979-00c95f4b0446", "name": "network-vif-plugged", "status": "completed", "tag": "50fa780a-0fba-4298-932c-ce424fb89844"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:43:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-7ab65df9-4272-4df0-a13d-2794c945883c req-075576bb-c447-4a25-82f9-f9454e46ffe9 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-7ab65df9-4272-4df0-a13d-2794c945883c req-075576bb-c447-4a25-82f9-f9454e46ffe9 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:16 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-7ab65df9-4272-4df0-a13d-2794c945883c req-075576bb-c447-4a25-82f9-f9454e46ffe9 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:16 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-7ab65df9-4272-4df0-a13d-2794c945883c req-075576bb-c447-4a25-82f9-f9454e46ffe9 service nova] Creating event network-vif-plugged:50fa780a-0fba-4298-932c-ce424fb89844 for instance 7f3425ec-c7ad-4443-8979-00c95f4b0446 on user Apr 18 14:43:16 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-7ab65df9-4272-4df0-a13d-2794c945883c req-075576bb-c447-4a25-82f9-f9454e46ffe9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034485 Apr 18 14:43:16 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 143/424] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:43:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:43:16 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-8c5f4de8-90c1-4b0d-8a53-75f572044a5b tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:16 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-8c5f4de8-90c1-4b0d-8a53-75f572044a5b tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: b0b435ff-00e9-47c1-880e-a57e55728ddc] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8c5f4de8-90c1-4b0d-8a53-75f572044a5b tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8c5f4de8-90c1-4b0d-8a53-75f572044a5b tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8c5f4de8-90c1-4b0d-8a53-75f572044a5b tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8c5f4de8-90c1-4b0d-8a53-75f572044a5b tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8c5f4de8-90c1-4b0d-8a53-75f572044a5b tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:16 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-8c5f4de8-90c1-4b0d-8a53-75f572044a5b tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:16 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-8c5f4de8-90c1-4b0d-8a53-75f572044a5b tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: b0b435ff-00e9-47c1-880e-a57e55728ddc] Going to try to terminate instance {{(pid=61310) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:43:16 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-8c5f4de8-90c1-4b0d-8a53-75f572044a5b tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc" status: 204 len: 0 microversion: 2.1 time: 0.130672 Apr 18 14:43:16 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 142/425] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:43:16 2023] DELETE /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 14:43:16 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-12b600a7-8a16-4d27-89dc-29dd748ec630 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:16 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-12b600a7-8a16-4d27-89dc-29dd748ec630 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: b0b435ff-00e9-47c1-880e-a57e55728ddc] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:16 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-12b600a7-8a16-4d27-89dc-29dd748ec630 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:16 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-12b600a7-8a16-4d27-89dc-29dd748ec630 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:16 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-12b600a7-8a16-4d27-89dc-29dd748ec630 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:16 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-12b600a7-8a16-4d27-89dc-29dd748ec630 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:16 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-12b600a7-8a16-4d27-89dc-29dd748ec630 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:16 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-12b600a7-8a16-4d27-89dc-29dd748ec630 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:17 user devstack@n-api.service[61311]: DEBUG nova.policy [None req-12b600a7-8a16-4d27-89dc-29dd748ec630 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43dd536529724c41980d5f2fddd8c71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38cf2921e9c49b98933eb439c2ea431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61311) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:43:17 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-09ecff4c-3e0e-4ece-8140-c6a9f5fc40fa req-75f29370-6bbd-4eb3-8abc-fc9a0fd5fa7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b435ff-00e9-47c1-880e-a57e55728ddc", "name": "network-vif-unplugged", "status": "completed", "tag": "91ad47bc-c68b-4554-bdc0-506626c8d6e0"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:43:17 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-12b600a7-8a16-4d27-89dc-29dd748ec630 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc" status: 200 len: 1670 microversion: 2.1 time: 0.266824 Apr 18 14:43:17 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 141/426] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:43:16 2023] GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc => generated 1670 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 14:43:17 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-09ecff4c-3e0e-4ece-8140-c6a9f5fc40fa req-75f29370-6bbd-4eb3-8abc-fc9a0fd5fa7c service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:17 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-09ecff4c-3e0e-4ece-8140-c6a9f5fc40fa req-75f29370-6bbd-4eb3-8abc-fc9a0fd5fa7c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:17 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-09ecff4c-3e0e-4ece-8140-c6a9f5fc40fa req-75f29370-6bbd-4eb3-8abc-fc9a0fd5fa7c service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:17 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-09ecff4c-3e0e-4ece-8140-c6a9f5fc40fa req-75f29370-6bbd-4eb3-8abc-fc9a0fd5fa7c service nova] Creating event network-vif-unplugged:91ad47bc-c68b-4554-bdc0-506626c8d6e0 for instance b0b435ff-00e9-47c1-880e-a57e55728ddc on user Apr 18 14:43:17 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-09ecff4c-3e0e-4ece-8140-c6a9f5fc40fa req-75f29370-6bbd-4eb3-8abc-fc9a0fd5fa7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028298 Apr 18 14:43:17 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 144/427] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:43:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:43:18 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-a90399a0-9645-4de2-b3c4-45a71eed0802 req-0f77e031-db01-40ae-8106-85eaba5e37d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b435ff-00e9-47c1-880e-a57e55728ddc", "name": "network-vif-deleted", "tag": "91ad47bc-c68b-4554-bdc0-506626c8d6e0"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:43:18 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-a90399a0-9645-4de2-b3c4-45a71eed0802 req-0f77e031-db01-40ae-8106-85eaba5e37d5 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:18 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-a90399a0-9645-4de2-b3c4-45a71eed0802 req-0f77e031-db01-40ae-8106-85eaba5e37d5 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:18 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-a90399a0-9645-4de2-b3c4-45a71eed0802 req-0f77e031-db01-40ae-8106-85eaba5e37d5 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:18 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-a90399a0-9645-4de2-b3c4-45a71eed0802 req-0f77e031-db01-40ae-8106-85eaba5e37d5 service nova] Creating event network-vif-deleted:91ad47bc-c68b-4554-bdc0-506626c8d6e0 for instance b0b435ff-00e9-47c1-880e-a57e55728ddc on user Apr 18 14:43:18 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-a90399a0-9645-4de2-b3c4-45a71eed0802 req-0f77e031-db01-40ae-8106-85eaba5e37d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030034 Apr 18 14:43:18 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 143/428] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:43:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:43:19 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-2d2c22e1-bc12-4038-96e6-575cbe939cad req-2cf5fb42-9dc8-4bb8-a2ba-7a31a8ece5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b435ff-00e9-47c1-880e-a57e55728ddc", "name": "network-vif-plugged", "status": "completed", "tag": "91ad47bc-c68b-4554-bdc0-506626c8d6e0"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:43:19 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-2d2c22e1-bc12-4038-96e6-575cbe939cad req-2cf5fb42-9dc8-4bb8-a2ba-7a31a8ece5e8 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:19 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-2d2c22e1-bc12-4038-96e6-575cbe939cad req-2cf5fb42-9dc8-4bb8-a2ba-7a31a8ece5e8 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:19 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-2d2c22e1-bc12-4038-96e6-575cbe939cad req-2cf5fb42-9dc8-4bb8-a2ba-7a31a8ece5e8 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:19 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-2d2c22e1-bc12-4038-96e6-575cbe939cad req-2cf5fb42-9dc8-4bb8-a2ba-7a31a8ece5e8 service nova] Creating event network-vif-plugged:91ad47bc-c68b-4554-bdc0-506626c8d6e0 for instance b0b435ff-00e9-47c1-880e-a57e55728ddc on user Apr 18 14:43:19 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-2d2c22e1-bc12-4038-96e6-575cbe939cad req-2cf5fb42-9dc8-4bb8-a2ba-7a31a8ece5e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048388 Apr 18 14:43:19 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 142/429] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:43:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-9eccac41-b679-4485-acfb-d66629bed39f tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-9eccac41-b679-4485-acfb-d66629bed39f tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: 47d56c29-010e-48a8-a1c6-8c62decfd02d] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-9eccac41-b679-4485-acfb-d66629bed39f tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-9eccac41-b679-4485-acfb-d66629bed39f tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-9eccac41-b679-4485-acfb-d66629bed39f tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-9eccac41-b679-4485-acfb-d66629bed39f tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-9eccac41-b679-4485-acfb-d66629bed39f tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-9eccac41-b679-4485-acfb-d66629bed39f tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:36 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-9eccac41-b679-4485-acfb-d66629bed39f tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] HTTP exception thrown: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-9eccac41-b679-4485-acfb-d66629bed39f tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Request method failure captured: Apr 18 14:43:36 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d HTTP/1.1 Apr 18 14:43:36 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:43:36 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:43:36 user devstack@n-api.service[61309]: Connection: close Apr 18 14:43:36 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:43:36 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:43:36 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:43:36 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:43:36 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqtKkU5MpeLMBuKGu5HdiO_tYh4DTAbE29lVw-p-ZgLflh1T9DfOCEugqsQ6Q9Tetd83cYO7vUi1mpZ23BylbP5rwdOGdKANdr4o5CHFHGOVZve6ig9Qw9xToecjuNcwICa2745L-2_Y0EgnSnqAda34ahy5og6vpI8pwkR-9YQttec Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Project-Id: 3549c53be65e4fc2a2bb124109319ca2 Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Tenant-Id: 3549c53be65e4fc2a2bb124109319ca2 Apr 18 14:43:36 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:36 user devstack@n-api.service[61309]: X-User: tempest-AttachVolumeShelveTestJSON-1759405781-project-member Apr 18 14:43:36 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:43:36 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:43:36 user devstack@n-api.service[61309]: X-User-Id: 8b4ce9342145403c9ba6a9871fbf490e Apr 18 14:43:36 user devstack@n-api.service[61309]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1759405781-project-member Apr 18 14:43:36 user devstack@n-api.service[61309]: method: > Apr 18 14:43:36 user devstack@n-api.service[61309]: exception: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:36 user devstack@n-api.service[61309]: action_args: {'id': '47d56c29-010e-48a8-a1c6-8c62decfd02d'} Apr 18 14:43:36 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:36 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:43:36 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-9eccac41-b679-4485-acfb-d66629bed39f tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Returning 404 to user: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:43:36 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-9eccac41-b679-4485-acfb-d66629bed39f tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d" status: 404 len: 111 microversion: 2.20 time: 0.183879 Apr 18 14:43:36 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 145/430] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:43:36 2023] GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 14:43:36 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:36 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:36 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-5c43f555-7fb7-40c7-a1bd-fba06974646c tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '.version_select at 0x7f5ceeafbf40>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:36 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-5c43f555-7fb7-40c7-a1bd-fba06974646c tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091878562" status: 204 len: 0 microversion: 2.20 time: 0.028381 Apr 18 14:43:36 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 144/431] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 18 14:43:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091878562 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-6f9801cd-e738-4605-b3e4-94f193104693 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-6f9801cd-e738-4605-b3e4-94f193104693 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: 47d56c29-010e-48a8-a1c6-8c62decfd02d] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=24 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6f9801cd-e738-4605-b3e4-94f193104693 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6f9801cd-e738-4605-b3e4-94f193104693 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6f9801cd-e738-4605-b3e4-94f193104693 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6f9801cd-e738-4605-b3e4-94f193104693 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6f9801cd-e738-4605-b3e4-94f193104693 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6f9801cd-e738-4605-b3e4-94f193104693 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:37 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-6f9801cd-e738-4605-b3e4-94f193104693 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] HTTP exception thrown: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-6f9801cd-e738-4605-b3e4-94f193104693 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Request method failure captured: Apr 18 14:43:37 user devstack@n-api.service[61311]: request: DELETE /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d HTTP/1.1 Apr 18 14:43:37 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:43:37 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:43:37 user devstack@n-api.service[61311]: Connection: close Apr 18 14:43:37 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:43:37 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:43:37 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:43:37 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:43:37 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqtKkU5MpeLMBuKGu5HdiO_tYh4DTAbE29lVw-p-ZgLflh1T9DfOCEugqsQ6Q9Tetd83cYO7vUi1mpZ23BylbP5rwdOGdKANdr4o5CHFHGOVZve6ig9Qw9xToecjuNcwICa2745L-2_Y0EgnSnqAda34ahy5og6vpI8pwkR-9YQttec Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Project-Id: 3549c53be65e4fc2a2bb124109319ca2 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Tenant-Id: 3549c53be65e4fc2a2bb124109319ca2 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-User: tempest-AttachVolumeShelveTestJSON-1759405781-project-member Apr 18 14:43:37 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:43:37 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:43:37 user devstack@n-api.service[61311]: X-User-Id: 8b4ce9342145403c9ba6a9871fbf490e Apr 18 14:43:37 user devstack@n-api.service[61311]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1759405781-project-member Apr 18 14:43:37 user devstack@n-api.service[61311]: method: > Apr 18 14:43:37 user devstack@n-api.service[61311]: exception: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61311]: action_args: {'id': '47d56c29-010e-48a8-a1c6-8c62decfd02d'} Apr 18 14:43:37 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-6f9801cd-e738-4605-b3e4-94f193104693 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Returning 404 to user: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:43:37 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-6f9801cd-e738-4605-b3e4-94f193104693 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d" status: 404 len: 111 microversion: 2.20 time: 0.039987 Apr 18 14:43:37 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 143/432] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 14:43:37 2023] DELETE /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 14:43:37 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-97879acf-81f3-46a7-9403-80bcf10e8364 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:37 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-97879acf-81f3-46a7-9403-80bcf10e8364 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: 47d56c29-010e-48a8-a1c6-8c62decfd02d] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-97879acf-81f3-46a7-9403-80bcf10e8364 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-97879acf-81f3-46a7-9403-80bcf10e8364 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-97879acf-81f3-46a7-9403-80bcf10e8364 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-97879acf-81f3-46a7-9403-80bcf10e8364 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-97879acf-81f3-46a7-9403-80bcf10e8364 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:37 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-97879acf-81f3-46a7-9403-80bcf10e8364 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:37 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-97879acf-81f3-46a7-9403-80bcf10e8364 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] HTTP exception thrown: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-97879acf-81f3-46a7-9403-80bcf10e8364 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Request method failure captured: Apr 18 14:43:37 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d HTTP/1.1 Apr 18 14:43:37 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:43:37 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:43:37 user devstack@n-api.service[61309]: Connection: close Apr 18 14:43:37 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:43:37 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:43:37 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:43:37 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:43:37 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqtKkU5MpeLMBuKGu5HdiO_tYh4DTAbE29lVw-p-ZgLflh1T9DfOCEugqsQ6Q9Tetd83cYO7vUi1mpZ23BylbP5rwdOGdKANdr4o5CHFHGOVZve6ig9Qw9xToecjuNcwICa2745L-2_Y0EgnSnqAda34ahy5og6vpI8pwkR-9YQttec Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Project-Id: 3549c53be65e4fc2a2bb124109319ca2 Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Tenant-Id: 3549c53be65e4fc2a2bb124109319ca2 Apr 18 14:43:37 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:37 user devstack@n-api.service[61309]: X-User: tempest-AttachVolumeShelveTestJSON-1759405781-project-member Apr 18 14:43:37 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:43:37 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:43:37 user devstack@n-api.service[61309]: X-User-Id: 8b4ce9342145403c9ba6a9871fbf490e Apr 18 14:43:37 user devstack@n-api.service[61309]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1759405781-project-member Apr 18 14:43:37 user devstack@n-api.service[61309]: method: > Apr 18 14:43:37 user devstack@n-api.service[61309]: exception: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61309]: action_args: {'id': '47d56c29-010e-48a8-a1c6-8c62decfd02d'} Apr 18 14:43:37 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-97879acf-81f3-46a7-9403-80bcf10e8364 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Returning 404 to user: Instance 47d56c29-010e-48a8-a1c6-8c62decfd02d could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:43:37 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-97879acf-81f3-46a7-9403-80bcf10e8364 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d" status: 404 len: 111 microversion: 2.20 time: 0.028309 Apr 18 14:43:37 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 146/433] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:43:37 2023] GET /compute/v2.1/servers/47d56c29-010e-48a8-a1c6-8c62decfd02d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 14:43:37 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-4241d3eb-b38d-4470-ae3e-8edca41ab3ab tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:37 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-4241d3eb-b38d-4470-ae3e-8edca41ab3ab tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: b3543651-513e-446d-a15d-563bc0c76e5d] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:37 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-4241d3eb-b38d-4470-ae3e-8edca41ab3ab tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:37 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-4241d3eb-b38d-4470-ae3e-8edca41ab3ab tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:37 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-4241d3eb-b38d-4470-ae3e-8edca41ab3ab tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:37 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-4241d3eb-b38d-4470-ae3e-8edca41ab3ab tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:37 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-4241d3eb-b38d-4470-ae3e-8edca41ab3ab tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:37 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-4241d3eb-b38d-4470-ae3e-8edca41ab3ab tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:37 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-4241d3eb-b38d-4470-ae3e-8edca41ab3ab tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] HTTP exception thrown: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-4241d3eb-b38d-4470-ae3e-8edca41ab3ab tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Request method failure captured: Apr 18 14:43:37 user devstack@n-api.service[61310]: request: DELETE /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d HTTP/1.1 Apr 18 14:43:37 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:43:37 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:43:37 user devstack@n-api.service[61310]: Connection: close Apr 18 14:43:37 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:43:37 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:43:37 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:43:37 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:43:37 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqtKkU5MpeLMBuKGu5HdiO_tYh4DTAbE29lVw-p-ZgLflh1T9DfOCEugqsQ6Q9Tetd83cYO7vUi1mpZ23BylbP5rwdOGdKANdr4o5CHFHGOVZve6ig9Qw9xToecjuNcwICa2745L-2_Y0EgnSnqAda34ahy5og6vpI8pwkR-9YQttec Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Project-Id: 3549c53be65e4fc2a2bb124109319ca2 Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Tenant-Id: 3549c53be65e4fc2a2bb124109319ca2 Apr 18 14:43:37 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:37 user devstack@n-api.service[61310]: X-User: tempest-AttachVolumeShelveTestJSON-1759405781-project-member Apr 18 14:43:37 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:43:37 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:43:37 user devstack@n-api.service[61310]: X-User-Id: 8b4ce9342145403c9ba6a9871fbf490e Apr 18 14:43:37 user devstack@n-api.service[61310]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1759405781-project-member Apr 18 14:43:37 user devstack@n-api.service[61310]: method: > Apr 18 14:43:37 user devstack@n-api.service[61310]: exception: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61310]: action_args: {'id': 'b3543651-513e-446d-a15d-563bc0c76e5d'} Apr 18 14:43:37 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-4241d3eb-b38d-4470-ae3e-8edca41ab3ab tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Returning 404 to user: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:43:37 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-4241d3eb-b38d-4470-ae3e-8edca41ab3ab tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d" status: 404 len: 111 microversion: 2.20 time: 0.029096 Apr 18 14:43:37 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 145/434] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 14:43:37 2023] DELETE /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-6253b723-f1c2-44b5-9614-9114db2da197 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-6253b723-f1c2-44b5-9614-9114db2da197 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] [instance: b3543651-513e-446d-a15d-563bc0c76e5d] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6253b723-f1c2-44b5-9614-9114db2da197 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6253b723-f1c2-44b5-9614-9114db2da197 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6253b723-f1c2-44b5-9614-9114db2da197 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6253b723-f1c2-44b5-9614-9114db2da197 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6253b723-f1c2-44b5-9614-9114db2da197 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-6253b723-f1c2-44b5-9614-9114db2da197 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:37 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-6253b723-f1c2-44b5-9614-9114db2da197 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] HTTP exception thrown: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-6253b723-f1c2-44b5-9614-9114db2da197 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Request method failure captured: Apr 18 14:43:37 user devstack@n-api.service[61311]: request: GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d HTTP/1.1 Apr 18 14:43:37 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:43:37 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:43:37 user devstack@n-api.service[61311]: Connection: close Apr 18 14:43:37 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:43:37 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:43:37 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:43:37 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:43:37 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqtKkU5MpeLMBuKGu5HdiO_tYh4DTAbE29lVw-p-ZgLflh1T9DfOCEugqsQ6Q9Tetd83cYO7vUi1mpZ23BylbP5rwdOGdKANdr4o5CHFHGOVZve6ig9Qw9xToecjuNcwICa2745L-2_Y0EgnSnqAda34ahy5og6vpI8pwkR-9YQttec Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Project-Id: 3549c53be65e4fc2a2bb124109319ca2 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3549c53be65e4fc2a2bb124109319ca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Tenant-Id: 3549c53be65e4fc2a2bb124109319ca2 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1759405781 Apr 18 14:43:37 user devstack@n-api.service[61311]: X-User: tempest-AttachVolumeShelveTestJSON-1759405781-project-member Apr 18 14:43:37 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:43:37 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:43:37 user devstack@n-api.service[61311]: X-User-Id: 8b4ce9342145403c9ba6a9871fbf490e Apr 18 14:43:37 user devstack@n-api.service[61311]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1759405781-project-member Apr 18 14:43:37 user devstack@n-api.service[61311]: method: > Apr 18 14:43:37 user devstack@n-api.service[61311]: exception: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61311]: action_args: {'id': 'b3543651-513e-446d-a15d-563bc0c76e5d'} Apr 18 14:43:37 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. Apr 18 14:43:37 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:43:37 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-6253b723-f1c2-44b5-9614-9114db2da197 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] Returning 404 to user: Instance b3543651-513e-446d-a15d-563bc0c76e5d could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:43:37 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-6253b723-f1c2-44b5-9614-9114db2da197 tempest-AttachVolumeShelveTestJSON-1759405781 tempest-AttachVolumeShelveTestJSON-1759405781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d" status: 404 len: 111 microversion: 2.20 time: 0.031427 Apr 18 14:43:37 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 144/435] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:43:37 2023] GET /compute/v2.1/servers/b3543651-513e-446d-a15d-563bc0c76e5d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=4 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=4 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-cdf62353-ad6f-4c18-b91f-b7c309869375 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-cdf62353-ad6f-4c18-b91f-b7c309869375 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 7f3425ec-c7ad-4443-8979-00c95f4b0446] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cdf62353-ad6f-4c18-b91f-b7c309869375 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cdf62353-ad6f-4c18-b91f-b7c309869375 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cdf62353-ad6f-4c18-b91f-b7c309869375 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cdf62353-ad6f-4c18-b91f-b7c309869375 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cdf62353-ad6f-4c18-b91f-b7c309869375 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-cdf62353-ad6f-4c18-b91f-b7c309869375 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-cdf62353-ad6f-4c18-b91f-b7c309869375 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-cdf62353-ad6f-4c18-b91f-b7c309869375 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:43:59 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-cdf62353-ad6f-4c18-b91f-b7c309869375 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:43:59 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-cdf62353-ad6f-4c18-b91f-b7c309869375 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446" status: 200 len: 1691 microversion: 2.87 time: 0.335121 Apr 18 14:44:00 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 147/436] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:43:59 2023] GET /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446 => generated 1691 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:44:07 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-103d8521-0aa7-4cb5-9848-292b517ab8f0 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:44:07 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-103d8521-0aa7-4cb5-9848-292b517ab8f0 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: b0b435ff-00e9-47c1-880e-a57e55728ddc] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:44:07 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:44:07 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:44:07 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-103d8521-0aa7-4cb5-9848-292b517ab8f0 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:07 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-103d8521-0aa7-4cb5-9848-292b517ab8f0 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:07 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-103d8521-0aa7-4cb5-9848-292b517ab8f0 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:07 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-103d8521-0aa7-4cb5-9848-292b517ab8f0 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:07 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-103d8521-0aa7-4cb5-9848-292b517ab8f0 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:07 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-103d8521-0aa7-4cb5-9848-292b517ab8f0 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:07 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-103d8521-0aa7-4cb5-9848-292b517ab8f0 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] HTTP exception thrown: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:07 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-103d8521-0aa7-4cb5-9848-292b517ab8f0 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Request method failure captured: Apr 18 14:44:07 user devstack@n-api.service[61310]: request: GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc HTTP/1.1 Apr 18 14:44:07 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:44:07 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:44:07 user devstack@n-api.service[61310]: Connection: close Apr 18 14:44:07 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:44:07 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:44:07 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:44:07 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:44:07 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqrDabR2U-1ioZsog1d_Oe7stjemJyN965_3QF6lSyU5B3aX0TjwgV2ScEQsf8XtbOQxLYBn1q1tQEMntGIoyvVq5cW3kqQZHF8J8pWejXnqQQvbKTw-fm6UUe-u_HRbu6moOhNBxxZ9yz3p89jNLYmODyaAAvgUGYugBI5gCAN3RRc Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Project-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Tenant: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Tenant-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:07 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:07 user devstack@n-api.service[61310]: X-User: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:07 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:44:07 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:44:07 user devstack@n-api.service[61310]: X-User-Id: 43dd536529724c41980d5f2fddd8c71d Apr 18 14:44:07 user devstack@n-api.service[61310]: X-User-Name: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:07 user devstack@n-api.service[61310]: method: > Apr 18 14:44:07 user devstack@n-api.service[61310]: exception: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:07 user devstack@n-api.service[61310]: action_args: {'id': 'b0b435ff-00e9-47c1-880e-a57e55728ddc'} Apr 18 14:44:07 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:07 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:07 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-103d8521-0aa7-4cb5-9848-292b517ab8f0 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Returning 404 to user: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:44:07 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-103d8521-0aa7-4cb5-9848-292b517ab8f0 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc" status: 404 len: 111 microversion: 2.1 time: 0.036359 Apr 18 14:44:07 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 146/437] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:44:07 2023] GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:44:07 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-5b4f8410-0960-4652-8691-6f077fec85f7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '.version_select at 0x7f5cee94d510>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:44:07 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:44:07 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:44:07 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-5b4f8410-0960-4652-8691-6f077fec85f7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1256067480" status: 202 len: 0 microversion: 2.1 time: 0.029062 Apr 18 14:44:07 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 145/438] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 14:44:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1256067480 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-6e332b50-11e3-4204-ac0f-bc146865d625 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-6e332b50-11e3-4204-ac0f-bc146865d625 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: b0b435ff-00e9-47c1-880e-a57e55728ddc] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-6e332b50-11e3-4204-ac0f-bc146865d625 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-6e332b50-11e3-4204-ac0f-bc146865d625 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-6e332b50-11e3-4204-ac0f-bc146865d625 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-6e332b50-11e3-4204-ac0f-bc146865d625 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-6e332b50-11e3-4204-ac0f-bc146865d625 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-6e332b50-11e3-4204-ac0f-bc146865d625 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:08 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-6e332b50-11e3-4204-ac0f-bc146865d625 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] HTTP exception thrown: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-6e332b50-11e3-4204-ac0f-bc146865d625 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Request method failure captured: Apr 18 14:44:08 user devstack@n-api.service[61309]: request: DELETE /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc HTTP/1.1 Apr 18 14:44:08 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:44:08 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:44:08 user devstack@n-api.service[61309]: Connection: close Apr 18 14:44:08 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:44:08 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:44:08 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:44:08 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:44:08 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqrDabR2U-1ioZsog1d_Oe7stjemJyN965_3QF6lSyU5B3aX0TjwgV2ScEQsf8XtbOQxLYBn1q1tQEMntGIoyvVq5cW3kqQZHF8J8pWejXnqQQvbKTw-fm6UUe-u_HRbu6moOhNBxxZ9yz3p89jNLYmODyaAAvgUGYugBI5gCAN3RRc Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Project-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Project-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Tenant: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Tenant-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61309]: X-User: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:08 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:44:08 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:44:08 user devstack@n-api.service[61309]: X-User-Id: 43dd536529724c41980d5f2fddd8c71d Apr 18 14:44:08 user devstack@n-api.service[61309]: X-User-Name: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:08 user devstack@n-api.service[61309]: method: > Apr 18 14:44:08 user devstack@n-api.service[61309]: exception: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:08 user devstack@n-api.service[61309]: action_args: {'id': 'b0b435ff-00e9-47c1-880e-a57e55728ddc'} Apr 18 14:44:08 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-6e332b50-11e3-4204-ac0f-bc146865d625 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Returning 404 to user: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:44:08 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-6e332b50-11e3-4204-ac0f-bc146865d625 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc" status: 404 len: 111 microversion: 2.1 time: 0.027276 Apr 18 14:44:08 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 148/439] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:44:08 2023] DELETE /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-fe0d4581-d619-4fc6-b5b7-e2645bbdbb42 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-fe0d4581-d619-4fc6-b5b7-e2645bbdbb42 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: b0b435ff-00e9-47c1-880e-a57e55728ddc] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-fe0d4581-d619-4fc6-b5b7-e2645bbdbb42 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-fe0d4581-d619-4fc6-b5b7-e2645bbdbb42 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-fe0d4581-d619-4fc6-b5b7-e2645bbdbb42 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-fe0d4581-d619-4fc6-b5b7-e2645bbdbb42 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-fe0d4581-d619-4fc6-b5b7-e2645bbdbb42 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-fe0d4581-d619-4fc6-b5b7-e2645bbdbb42 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:08 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-fe0d4581-d619-4fc6-b5b7-e2645bbdbb42 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] HTTP exception thrown: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-fe0d4581-d619-4fc6-b5b7-e2645bbdbb42 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Request method failure captured: Apr 18 14:44:08 user devstack@n-api.service[61310]: request: GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc HTTP/1.1 Apr 18 14:44:08 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:44:08 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:44:08 user devstack@n-api.service[61310]: Connection: close Apr 18 14:44:08 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:44:08 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:44:08 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:44:08 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:44:08 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqrDabR2U-1ioZsog1d_Oe7stjemJyN965_3QF6lSyU5B3aX0TjwgV2ScEQsf8XtbOQxLYBn1q1tQEMntGIoyvVq5cW3kqQZHF8J8pWejXnqQQvbKTw-fm6UUe-u_HRbu6moOhNBxxZ9yz3p89jNLYmODyaAAvgUGYugBI5gCAN3RRc Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Project-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Tenant: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Tenant-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61310]: X-User: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:08 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:44:08 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:44:08 user devstack@n-api.service[61310]: X-User-Id: 43dd536529724c41980d5f2fddd8c71d Apr 18 14:44:08 user devstack@n-api.service[61310]: X-User-Name: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:08 user devstack@n-api.service[61310]: method: > Apr 18 14:44:08 user devstack@n-api.service[61310]: exception: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:08 user devstack@n-api.service[61310]: action_args: {'id': 'b0b435ff-00e9-47c1-880e-a57e55728ddc'} Apr 18 14:44:08 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-fe0d4581-d619-4fc6-b5b7-e2645bbdbb42 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Returning 404 to user: Instance b0b435ff-00e9-47c1-880e-a57e55728ddc could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:44:08 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-fe0d4581-d619-4fc6-b5b7-e2645bbdbb42 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc" status: 404 len: 111 microversion: 2.1 time: 0.029714 Apr 18 14:44:08 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 147/440] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:44:08 2023] GET /compute/v2.1/servers/b0b435ff-00e9-47c1-880e-a57e55728ddc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-3fd0f38f-6ebc-4275-99f4-220acb973ad7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-3fd0f38f-6ebc-4275-99f4-220acb973ad7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-3fd0f38f-6ebc-4275-99f4-220acb973ad7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-3fd0f38f-6ebc-4275-99f4-220acb973ad7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-3fd0f38f-6ebc-4275-99f4-220acb973ad7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-3fd0f38f-6ebc-4275-99f4-220acb973ad7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-3fd0f38f-6ebc-4275-99f4-220acb973ad7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-3fd0f38f-6ebc-4275-99f4-220acb973ad7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:08 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-3fd0f38f-6ebc-4275-99f4-220acb973ad7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] HTTP exception thrown: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-3fd0f38f-6ebc-4275-99f4-220acb973ad7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Request method failure captured: Apr 18 14:44:08 user devstack@n-api.service[61311]: request: DELETE /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 HTTP/1.1 Apr 18 14:44:08 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:44:08 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:44:08 user devstack@n-api.service[61311]: Connection: close Apr 18 14:44:08 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:44:08 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:44:08 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:44:08 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:44:08 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqrDabR2U-1ioZsog1d_Oe7stjemJyN965_3QF6lSyU5B3aX0TjwgV2ScEQsf8XtbOQxLYBn1q1tQEMntGIoyvVq5cW3kqQZHF8J8pWejXnqQQvbKTw-fm6UUe-u_HRbu6moOhNBxxZ9yz3p89jNLYmODyaAAvgUGYugBI5gCAN3RRc Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Project-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Project-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Tenant: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Tenant-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61311]: X-User: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:08 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:44:08 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:44:08 user devstack@n-api.service[61311]: X-User-Id: 43dd536529724c41980d5f2fddd8c71d Apr 18 14:44:08 user devstack@n-api.service[61311]: X-User-Name: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:08 user devstack@n-api.service[61311]: method: > Apr 18 14:44:08 user devstack@n-api.service[61311]: exception: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61311]: action_args: {'id': '9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1'} Apr 18 14:44:08 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-3fd0f38f-6ebc-4275-99f4-220acb973ad7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Returning 404 to user: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:44:08 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-3fd0f38f-6ebc-4275-99f4-220acb973ad7 tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1" status: 404 len: 111 microversion: 2.1 time: 0.030599 Apr 18 14:44:08 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 146/441] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:44:08 2023] DELETE /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-d296a3e1-c166-46cf-bdd3-f72a5bd3ba5f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-d296a3e1-c166-46cf-bdd3-f72a5bd3ba5f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d296a3e1-c166-46cf-bdd3-f72a5bd3ba5f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d296a3e1-c166-46cf-bdd3-f72a5bd3ba5f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d296a3e1-c166-46cf-bdd3-f72a5bd3ba5f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d296a3e1-c166-46cf-bdd3-f72a5bd3ba5f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d296a3e1-c166-46cf-bdd3-f72a5bd3ba5f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-d296a3e1-c166-46cf-bdd3-f72a5bd3ba5f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:08 user devstack@n-api.service[61309]: INFO nova.api.openstack.wsgi [None req-d296a3e1-c166-46cf-bdd3-f72a5bd3ba5f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] HTTP exception thrown: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-d296a3e1-c166-46cf-bdd3-f72a5bd3ba5f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Request method failure captured: Apr 18 14:44:08 user devstack@n-api.service[61309]: request: GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 HTTP/1.1 Apr 18 14:44:08 user devstack@n-api.service[61309]: Accept: application/json Apr 18 14:44:08 user devstack@n-api.service[61309]: Accept-Encoding: identity Apr 18 14:44:08 user devstack@n-api.service[61309]: Connection: close Apr 18 14:44:08 user devstack@n-api.service[61309]: Content-Length: 0 Apr 18 14:44:08 user devstack@n-api.service[61309]: Content-Type: application/json Apr 18 14:44:08 user devstack@n-api.service[61309]: Host: 10.0.0.210 Apr 18 14:44:08 user devstack@n-api.service[61309]: Openstack-System-Scope: None Apr 18 14:44:08 user devstack@n-api.service[61309]: User-Agent: python-urllib3/1.26.15 Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Auth-Token: gAAAAABkPqrDabR2U-1ioZsog1d_Oe7stjemJyN965_3QF6lSyU5B3aX0TjwgV2ScEQsf8XtbOQxLYBn1q1tQEMntGIoyvVq5cW3kqQZHF8J8pWejXnqQQvbKTw-fm6UUe-u_HRbu6moOhNBxxZ9yz3p89jNLYmODyaAAvgUGYugBI5gCAN3RRc Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Domain-Id: None Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Domain-Name: None Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Identity-Status: Confirmed Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Is-Admin-Project: True Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Project-Domain-Id: default Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Project-Domain-Name: Default Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Project-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Project-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Role: reader,member Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Roles: reader,member Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Tenant: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Tenant-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:08 user devstack@n-api.service[61309]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61309]: X-User: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:08 user devstack@n-api.service[61309]: X-User-Domain-Id: default Apr 18 14:44:08 user devstack@n-api.service[61309]: X-User-Domain-Name: Default Apr 18 14:44:08 user devstack@n-api.service[61309]: X-User-Id: 43dd536529724c41980d5f2fddd8c71d Apr 18 14:44:08 user devstack@n-api.service[61309]: X-User-Name: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:08 user devstack@n-api.service[61309]: method: > Apr 18 14:44:08 user devstack@n-api.service[61309]: exception: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61309]: action_args: {'id': '9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1'} Apr 18 14:44:08 user devstack@n-api.service[61309]: {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61309]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-d296a3e1-c166-46cf-bdd3-f72a5bd3ba5f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Returning 404 to user: Instance 9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 could not be found. {{(pid=61309) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:44:08 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-d296a3e1-c166-46cf-bdd3-f72a5bd3ba5f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1" status: 404 len: 111 microversion: 2.1 time: 0.026879 Apr 18 14:44:08 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 149/442] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:44:08 2023] GET /compute/v2.1/servers/9f57d6a9-a288-4ff8-95d9-5c4df1d9b5c1 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-feb4a058-d591-45cc-bcad-c04a6288986d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-feb4a058-d591-45cc-bcad-c04a6288986d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 84ecf5bb-f207-4523-bb55-fb147ede0570] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-feb4a058-d591-45cc-bcad-c04a6288986d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-feb4a058-d591-45cc-bcad-c04a6288986d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-feb4a058-d591-45cc-bcad-c04a6288986d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-feb4a058-d591-45cc-bcad-c04a6288986d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-feb4a058-d591-45cc-bcad-c04a6288986d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-feb4a058-d591-45cc-bcad-c04a6288986d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:08 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-feb4a058-d591-45cc-bcad-c04a6288986d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] HTTP exception thrown: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-feb4a058-d591-45cc-bcad-c04a6288986d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Request method failure captured: Apr 18 14:44:08 user devstack@n-api.service[61310]: request: DELETE /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570 HTTP/1.1 Apr 18 14:44:08 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:44:08 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:44:08 user devstack@n-api.service[61310]: Connection: close Apr 18 14:44:08 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:44:08 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:44:08 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:44:08 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:44:08 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPqrDabR2U-1ioZsog1d_Oe7stjemJyN965_3QF6lSyU5B3aX0TjwgV2ScEQsf8XtbOQxLYBn1q1tQEMntGIoyvVq5cW3kqQZHF8J8pWejXnqQQvbKTw-fm6UUe-u_HRbu6moOhNBxxZ9yz3p89jNLYmODyaAAvgUGYugBI5gCAN3RRc Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Project-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Tenant: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Tenant-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:08 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61310]: X-User: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:08 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:44:08 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:44:08 user devstack@n-api.service[61310]: X-User-Id: 43dd536529724c41980d5f2fddd8c71d Apr 18 14:44:08 user devstack@n-api.service[61310]: X-User-Name: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:08 user devstack@n-api.service[61310]: method: > Apr 18 14:44:08 user devstack@n-api.service[61310]: exception: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61310]: action_args: {'id': '84ecf5bb-f207-4523-bb55-fb147ede0570'} Apr 18 14:44:08 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-feb4a058-d591-45cc-bcad-c04a6288986d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Returning 404 to user: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:44:08 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-feb4a058-d591-45cc-bcad-c04a6288986d tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570" status: 404 len: 111 microversion: 2.1 time: 0.034884 Apr 18 14:44:08 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 148/443] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 14:44:08 2023] DELETE /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-32ce71ca-b15b-4379-9656-527b09f4697f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-32ce71ca-b15b-4379-9656-527b09f4697f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] [instance: 84ecf5bb-f207-4523-bb55-fb147ede0570] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-32ce71ca-b15b-4379-9656-527b09f4697f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-32ce71ca-b15b-4379-9656-527b09f4697f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-32ce71ca-b15b-4379-9656-527b09f4697f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-32ce71ca-b15b-4379-9656-527b09f4697f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-32ce71ca-b15b-4379-9656-527b09f4697f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-32ce71ca-b15b-4379-9656-527b09f4697f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:44:08 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-32ce71ca-b15b-4379-9656-527b09f4697f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] HTTP exception thrown: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-32ce71ca-b15b-4379-9656-527b09f4697f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Request method failure captured: Apr 18 14:44:08 user devstack@n-api.service[61311]: request: GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570 HTTP/1.1 Apr 18 14:44:08 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:44:08 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:44:08 user devstack@n-api.service[61311]: Connection: close Apr 18 14:44:08 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:44:08 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:44:08 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:44:08 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:44:08 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPqrDabR2U-1ioZsog1d_Oe7stjemJyN965_3QF6lSyU5B3aX0TjwgV2ScEQsf8XtbOQxLYBn1q1tQEMntGIoyvVq5cW3kqQZHF8J8pWejXnqQQvbKTw-fm6UUe-u_HRbu6moOhNBxxZ9yz3p89jNLYmODyaAAvgUGYugBI5gCAN3RRc Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Project-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Project-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38cf2921e9c49b98933eb439c2ea431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Tenant: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Tenant-Id: e38cf2921e9c49b98933eb439c2ea431 Apr 18 14:44:08 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1144777901 Apr 18 14:44:08 user devstack@n-api.service[61311]: X-User: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:08 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:44:08 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:44:08 user devstack@n-api.service[61311]: X-User-Id: 43dd536529724c41980d5f2fddd8c71d Apr 18 14:44:08 user devstack@n-api.service[61311]: X-User-Name: tempest-AttachVolumeNegativeTest-1144777901-project-member Apr 18 14:44:08 user devstack@n-api.service[61311]: method: > Apr 18 14:44:08 user devstack@n-api.service[61311]: exception: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61311]: action_args: {'id': '84ecf5bb-f207-4523-bb55-fb147ede0570'} Apr 18 14:44:08 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. Apr 18 14:44:08 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:44:08 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-32ce71ca-b15b-4379-9656-527b09f4697f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] Returning 404 to user: Instance 84ecf5bb-f207-4523-bb55-fb147ede0570 could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:44:08 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-32ce71ca-b15b-4379-9656-527b09f4697f tempest-AttachVolumeNegativeTest-1144777901 tempest-AttachVolumeNegativeTest-1144777901-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570" status: 404 len: 111 microversion: 2.1 time: 0.035957 Apr 18 14:44:08 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 147/444] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 14:44:08 2023] GET /compute/v2.1/servers/84ecf5bb-f207-4523-bb55-fb147ede0570 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 14:45:00 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=8 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:45:00 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=10 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:45:00 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-4aaf5a99-fc5e-41e2-85bf-6662094dcf50 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-2035054376"}} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:45:00 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-4aaf5a99-fc5e-41e2-85bf-6662094dcf50 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 7f3425ec-c7ad-4443-8979-00c95f4b0446] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:45:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4aaf5a99-fc5e-41e2-85bf-6662094dcf50 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:45:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4aaf5a99-fc5e-41e2-85bf-6662094dcf50 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:45:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4aaf5a99-fc5e-41e2-85bf-6662094dcf50 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:45:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4aaf5a99-fc5e-41e2-85bf-6662094dcf50 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:45:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4aaf5a99-fc5e-41e2-85bf-6662094dcf50 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:45:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-4aaf5a99-fc5e-41e2-85bf-6662094dcf50 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:45:01 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-4aaf5a99-fc5e-41e2-85bf-6662094dcf50 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446/action" status: 202 len: 52 microversion: 2.87 time: 1.250459 Apr 18 14:45:01 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 150/445] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 14:45:00 2023] POST /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446/action => generated 52 bytes in 1253 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-c46a1225-ec2d-40ed-bdcd-540a0c9a8d93 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-c46a1225-ec2d-40ed-bdcd-540a0c9a8d93 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 7f3425ec-c7ad-4443-8979-00c95f4b0446] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c46a1225-ec2d-40ed-bdcd-540a0c9a8d93 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c46a1225-ec2d-40ed-bdcd-540a0c9a8d93 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c46a1225-ec2d-40ed-bdcd-540a0c9a8d93 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c46a1225-ec2d-40ed-bdcd-540a0c9a8d93 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c46a1225-ec2d-40ed-bdcd-540a0c9a8d93 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c46a1225-ec2d-40ed-bdcd-540a0c9a8d93 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-c46a1225-ec2d-40ed-bdcd-540a0c9a8d93 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-c46a1225-ec2d-40ed-bdcd-540a0c9a8d93 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:45:06 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-c46a1225-ec2d-40ed-bdcd-540a0c9a8d93 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:45:06 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-c46a1225-ec2d-40ed-bdcd-540a0c9a8d93 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446" status: 200 len: 1691 microversion: 2.87 time: 0.394314 Apr 18 14:45:06 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 149/446] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:45:06 2023] GET /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446 => generated 1691 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:07 user devstack@n-api.service[61311]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 14:46:07 user devstack@n-api.service[61311]: Tue Apr 18 14:46:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 18 14:46:07 user devstack@n-api.service[61311]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 14:46:07 user devstack@n-api.service[61311]: Tue Apr 18 14:46:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-233936911", "imageRef": "e440225d-a438-40cc-be07-38db2a963dd0", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "e440225d-a438-40cc-be07-38db2a963dd0", "destination_type": "volume"}], "networks": [{"uuid": "8edeafd7-9a4e-4c72-b1e3-a40f1a6e70aa"}]}} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG nova.network.neutron [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] validate_networks() for [('8edeafd7-9a4e-4c72-b1e3-a40f1a6e70aa', None, None, None, None, None)] {{(pid=61311) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Flavor limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Image limits 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Flavor pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Image pref 0:0:0 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG nova.virt.hardware [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Getting quotas for project f1bb3c50254545ff88c6bb55ccd16e7c. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG nova.quota [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Getting quotas for user bf32806393ed4030970e1a6e445bc43d and project f1bb3c50254545ff88c6bb55ccd16e7c. Resources: {'cores', 'ram', 'instances'} {{(pid=61311) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Going to run 1 instances... {{(pid=61311) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 14:46:07 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e440225d-a438-40cc-be07-38db2a963dd0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61311) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 14:46:07 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-69767499-542c-4738-87c8-799e4da175d2 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.679539 Apr 18 14:46:07 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 148/447] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 14:46:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 14:46:07 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:07 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:07 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-6af7d502-f4a3-4fbb-b936-a58b1630b918 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:46:07 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-6af7d502-f4a3-4fbb-b936-a58b1630b918 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:46:07 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-6af7d502-f4a3-4fbb-b936-a58b1630b918 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:46:07 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-6af7d502-f4a3-4fbb-b936-a58b1630b918 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:46:07 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-6af7d502-f4a3-4fbb-b936-a58b1630b918 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:46:07 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-6af7d502-f4a3-4fbb-b936-a58b1630b918 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c225f5fb-29f3-4c87-8b51-0618a35fe819" status: 200 len: 1394 microversion: 2.87 time: 0.168079 Apr 18 14:46:07 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 151/448] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:46:07 2023] GET /compute/v2.1/servers/c225f5fb-29f3-4c87-8b51-0618a35fe819 => generated 1394 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:46:10 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:10 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:10 user devstack@n-api.service[61310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 14:46:10 user devstack@n-api.service[61310]: Tue Apr 18 14:46:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 18 14:46:10 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-6dfb4efe-f27f-4b15-be42-c47c491b51c1 req-3a4d5567-27e5-4814-aa2c-ce2567edeb74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c225f5fb-29f3-4c87-8b51-0618a35fe819", "tag": "6606ebc1-16b8-41e3-8080-246da3a116b9"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:46:10 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-6dfb4efe-f27f-4b15-be42-c47c491b51c1 req-3a4d5567-27e5-4814-aa2c-ce2567edeb74 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:10 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-6dfb4efe-f27f-4b15-be42-c47c491b51c1 req-3a4d5567-27e5-4814-aa2c-ce2567edeb74 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:10 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-6dfb4efe-f27f-4b15-be42-c47c491b51c1 req-3a4d5567-27e5-4814-aa2c-ce2567edeb74 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:10 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-6dfb4efe-f27f-4b15-be42-c47c491b51c1 req-3a4d5567-27e5-4814-aa2c-ce2567edeb74 service nova] Creating event network-changed:6606ebc1-16b8-41e3-8080-246da3a116b9 for instance c225f5fb-29f3-4c87-8b51-0618a35fe819 on user Apr 18 14:46:10 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-6dfb4efe-f27f-4b15-be42-c47c491b51c1 req-3a4d5567-27e5-4814-aa2c-ce2567edeb74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094531 Apr 18 14:46:10 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 150/449] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:46:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:46:15 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-67d18a0c-051a-4d93-a8d1-05448336dfb2 req-9dd746f8-d459-4b36-8b71-2682fe94d086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c225f5fb-29f3-4c87-8b51-0618a35fe819", "name": "network-vif-deleted", "tag": "6606ebc1-16b8-41e3-8080-246da3a116b9"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:46:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-67d18a0c-051a-4d93-a8d1-05448336dfb2 req-9dd746f8-d459-4b36-8b71-2682fe94d086 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-67d18a0c-051a-4d93-a8d1-05448336dfb2 req-9dd746f8-d459-4b36-8b71-2682fe94d086 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:15 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-67d18a0c-051a-4d93-a8d1-05448336dfb2 req-9dd746f8-d459-4b36-8b71-2682fe94d086 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:15 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.compute.server_external_events [req-67d18a0c-051a-4d93-a8d1-05448336dfb2 req-9dd746f8-d459-4b36-8b71-2682fe94d086 service nova] Unable to find a host for instance c225f5fb-29f3-4c87-8b51-0618a35fe819. Dropping event network-vif-deleted {{(pid=61311) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 14:46:15 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-67d18a0c-051a-4d93-a8d1-05448336dfb2 req-9dd746f8-d459-4b36-8b71-2682fe94d086 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.028778 Apr 18 14:46:15 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 149/450] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:46:15 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell0:SELECT=2 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=6 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG nova.objects.instance [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lazy-loading 'fault' on Instance uuid c225f5fb-29f3-4c87-8b51-0618a35fe819 {{(pid=61309) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG nova.policy [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61309) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:46:58 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-7a611e98-88f9-488c-be2e-e477d972939f tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c225f5fb-29f3-4c87-8b51-0618a35fe819" status: 200 len: 1649 microversion: 2.87 time: 0.157569 Apr 18 14:46:58 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 152/451] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:46:58 2023] GET /compute/v2.1/servers/c225f5fb-29f3-4c87-8b51-0618a35fe819 => generated 1649 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=2 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] Going to try to terminate instance {{(pid=61310) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] Doing local delete in cell 337bb0b3-02d6-4a06-882a-72d8b3d786a4(cell1) {{(pid=61310) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:58 user devstack@n-api.service[61310]: WARNING nova.compute.api [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] instance's host None is down, deleting from database Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG nova.network.neutron [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] deallocate_for_instance() {{(pid=61310) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG nova.network.neutron [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] Instance cache missing network info. {{(pid=61310) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG nova.network.neutron [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] Updating instance_info_cache with network_info: [] {{(pid=61310) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 14:46:58 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61310) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 14:46:58 user devstack@n-api.service[61310]: WARNING nova.compute.api [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 14:46:58 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-582c65ba-db88-4da2-adcf-1847791a9764 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c225f5fb-29f3-4c87-8b51-0618a35fe819" status: 204 len: 0 microversion: 2.87 time: 0.488034 Apr 18 14:46:58 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 151/452] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 14:46:58 2023] DELETE /compute/v2.1/servers/c225f5fb-29f3-4c87-8b51-0618a35fe819 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-4d631b06-388d-4188-840b-100b0f630712 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-4d631b06-388d-4188-840b-100b0f630712 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: c225f5fb-29f3-4c87-8b51-0618a35fe819] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=2 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell0:SELECT=6 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:58 user devstack@n-api.service[61311]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 18 14:46:58 user devstack@n-api.service[61311]: Tue Apr 18 14:46:58 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c225f5fb-29f3-4c87-8b51-0618a35fe819 (ip 10.0.0.210) !!! Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4d631b06-388d-4188-840b-100b0f630712 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4d631b06-388d-4188-840b-100b0f630712 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4d631b06-388d-4188-840b-100b0f630712 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4d631b06-388d-4188-840b-100b0f630712 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4d631b06-388d-4188-840b-100b0f630712 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-4d631b06-388d-4188-840b-100b0f630712 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:58 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-4d631b06-388d-4188-840b-100b0f630712 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] HTTP exception thrown: Instance c225f5fb-29f3-4c87-8b51-0618a35fe819 could not be found. Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-4d631b06-388d-4188-840b-100b0f630712 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Request method failure captured: Apr 18 14:46:58 user devstack@n-api.service[61311]: request: GET /compute/v2.1/servers/c225f5fb-29f3-4c87-8b51-0618a35fe819 HTTP/1.1 Apr 18 14:46:58 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:46:58 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:46:58 user devstack@n-api.service[61311]: Connection: close Apr 18 14:46:58 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:46:58 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:46:58 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:46:58 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:46:58 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPquWKJBvwso4M8w_PrqFgWouKYzz98R_LdX8iNdfa-iE9UJYFZIUWX8D4yRZEVrXAeROwACDgbqMjS3DBWh518wJ3jucUKcsFu0x9ga9izvkEDvu1FvHyddvDvcXD-wa5I2LNTlPtGx0_nvmO8Y9FBYlt7eOaM2bokgvbkwt_EgFHfc Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Project-Id: f1bb3c50254545ff88c6bb55ccd16e7c Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-727141871 Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1bb3c50254545ff88c6bb55ccd16e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1bb3c50254545ff88c6bb55ccd16e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1bb3c50254545ff88c6bb55ccd16e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-727141871 Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Tenant-Id: f1bb3c50254545ff88c6bb55ccd16e7c Apr 18 14:46:58 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-727141871 Apr 18 14:46:58 user devstack@n-api.service[61311]: X-User: tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member Apr 18 14:46:58 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:46:58 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:46:58 user devstack@n-api.service[61311]: X-User-Id: bf32806393ed4030970e1a6e445bc43d Apr 18 14:46:58 user devstack@n-api.service[61311]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member Apr 18 14:46:58 user devstack@n-api.service[61311]: method: > Apr 18 14:46:58 user devstack@n-api.service[61311]: exception: Instance c225f5fb-29f3-4c87-8b51-0618a35fe819 could not be found. Apr 18 14:46:58 user devstack@n-api.service[61311]: action_args: {'id': 'c225f5fb-29f3-4c87-8b51-0618a35fe819'} Apr 18 14:46:58 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c225f5fb-29f3-4c87-8b51-0618a35fe819 could not be found. Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c225f5fb-29f3-4c87-8b51-0618a35fe819 could not be found. Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c225f5fb-29f3-4c87-8b51-0618a35fe819 could not be found. Apr 18 14:46:58 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:46:58 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-4d631b06-388d-4188-840b-100b0f630712 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Returning 404 to user: Instance c225f5fb-29f3-4c87-8b51-0618a35fe819 could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:46:58 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-4d631b06-388d-4188-840b-100b0f630712 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c225f5fb-29f3-4c87-8b51-0618a35fe819" status: 404 len: 111 microversion: 2.87 time: 0.046086 Apr 18 14:46:58 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 150/453] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:46:58 2023] GET /compute/v2.1/servers/c225f5fb-29f3-4c87-8b51-0618a35fe819 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-eb7a0b69-9784-40ab-9efb-c1193c49337b tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-eb7a0b69-9784-40ab-9efb-c1193c49337b tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 7f3425ec-c7ad-4443-8979-00c95f4b0446] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-eb7a0b69-9784-40ab-9efb-c1193c49337b tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-eb7a0b69-9784-40ab-9efb-c1193c49337b tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-eb7a0b69-9784-40ab-9efb-c1193c49337b tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-eb7a0b69-9784-40ab-9efb-c1193c49337b tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-eb7a0b69-9784-40ab-9efb-c1193c49337b tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-eb7a0b69-9784-40ab-9efb-c1193c49337b tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:58 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-eb7a0b69-9784-40ab-9efb-c1193c49337b tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 7f3425ec-c7ad-4443-8979-00c95f4b0446] Going to try to terminate instance {{(pid=61309) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:46:59 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-eb7a0b69-9784-40ab-9efb-c1193c49337b tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446" status: 204 len: 0 microversion: 2.87 time: 0.111120 Apr 18 14:46:59 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 153/454] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 14:46:58 2023] DELETE /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 14:46:59 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-0f82e486-da6f-4a5b-8db0-24a0a4f367f1 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:46:59 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-0f82e486-da6f-4a5b-8db0-24a0a4f367f1 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 7f3425ec-c7ad-4443-8979-00c95f4b0446] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:46:59 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0f82e486-da6f-4a5b-8db0-24a0a4f367f1 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:59 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0f82e486-da6f-4a5b-8db0-24a0a4f367f1 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:59 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0f82e486-da6f-4a5b-8db0-24a0a4f367f1 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:59 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0f82e486-da6f-4a5b-8db0-24a0a4f367f1 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:59 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0f82e486-da6f-4a5b-8db0-24a0a4f367f1 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:59 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-0f82e486-da6f-4a5b-8db0-24a0a4f367f1 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:59 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-0f82e486-da6f-4a5b-8db0-24a0a4f367f1 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:46:59 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-0f82e486-da6f-4a5b-8db0-24a0a4f367f1 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:46:59 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-0f82e486-da6f-4a5b-8db0-24a0a4f367f1 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:46:59 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-0f82e486-da6f-4a5b-8db0-24a0a4f367f1 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446" status: 200 len: 1697 microversion: 2.87 time: 0.311234 Apr 18 14:46:59 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 152/455] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:46:59 2023] GET /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446 => generated 1697 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:46:59 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-bad2d4ec-1494-403f-83e9-199c294e183a req-bc4e4df7-dca2-48cb-86e9-773482858b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f3425ec-c7ad-4443-8979-00c95f4b0446", "name": "network-vif-unplugged", "status": "completed", "tag": "50fa780a-0fba-4298-932c-ce424fb89844"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:46:59 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-bad2d4ec-1494-403f-83e9-199c294e183a req-bc4e4df7-dca2-48cb-86e9-773482858b48 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:46:59 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-bad2d4ec-1494-403f-83e9-199c294e183a req-bc4e4df7-dca2-48cb-86e9-773482858b48 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:46:59 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-bad2d4ec-1494-403f-83e9-199c294e183a req-bc4e4df7-dca2-48cb-86e9-773482858b48 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:46:59 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-bad2d4ec-1494-403f-83e9-199c294e183a req-bc4e4df7-dca2-48cb-86e9-773482858b48 service nova] Creating event network-vif-unplugged:50fa780a-0fba-4298-932c-ce424fb89844 for instance 7f3425ec-c7ad-4443-8979-00c95f4b0446 on user Apr 18 14:46:59 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-bad2d4ec-1494-403f-83e9-199c294e183a req-bc4e4df7-dca2-48cb-86e9-773482858b48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099384 Apr 18 14:46:59 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 151/456] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:46:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:47:00 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-38d058e1-5269-4b27-9944-e89ad1f540ed req-f25ba830-209f-4870-a5e7-4e7ccedb76cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f3425ec-c7ad-4443-8979-00c95f4b0446", "name": "network-vif-deleted", "tag": "50fa780a-0fba-4298-932c-ce424fb89844"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:47:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-38d058e1-5269-4b27-9944-e89ad1f540ed req-f25ba830-209f-4870-a5e7-4e7ccedb76cd service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:47:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-38d058e1-5269-4b27-9944-e89ad1f540ed req-f25ba830-209f-4870-a5e7-4e7ccedb76cd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:47:00 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-38d058e1-5269-4b27-9944-e89ad1f540ed req-f25ba830-209f-4870-a5e7-4e7ccedb76cd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:47:00 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-38d058e1-5269-4b27-9944-e89ad1f540ed req-f25ba830-209f-4870-a5e7-4e7ccedb76cd service nova] Creating event network-vif-deleted:50fa780a-0fba-4298-932c-ce424fb89844 for instance 7f3425ec-c7ad-4443-8979-00c95f4b0446 on user Apr 18 14:47:00 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-38d058e1-5269-4b27-9944-e89ad1f540ed req-f25ba830-209f-4870-a5e7-4e7ccedb76cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030111 Apr 18 14:47:00 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 154/457] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:47:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:47:01 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [req-5f267d35-0b36-49be-8acd-31a88d013655 req-2a3e5878-7d12-49dc-a901-63875655f9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f3425ec-c7ad-4443-8979-00c95f4b0446", "name": "network-vif-plugged", "status": "completed", "tag": "50fa780a-0fba-4298-932c-ce424fb89844"}]} {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:47:01 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-5f267d35-0b36-49be-8acd-31a88d013655 req-2a3e5878-7d12-49dc-a901-63875655f9bd service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:47:01 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-5f267d35-0b36-49be-8acd-31a88d013655 req-2a3e5878-7d12-49dc-a901-63875655f9bd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:47:01 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [req-5f267d35-0b36-49be-8acd-31a88d013655 req-2a3e5878-7d12-49dc-a901-63875655f9bd service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:47:01 user devstack@n-api.service[61310]: INFO nova.api.openstack.compute.server_external_events [req-5f267d35-0b36-49be-8acd-31a88d013655 req-2a3e5878-7d12-49dc-a901-63875655f9bd service nova] Creating event network-vif-plugged:50fa780a-0fba-4298-932c-ce424fb89844 for instance 7f3425ec-c7ad-4443-8979-00c95f4b0446 on user Apr 18 14:47:01 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [req-5f267d35-0b36-49be-8acd-31a88d013655 req-2a3e5878-7d12-49dc-a901-63875655f9bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029623 Apr 18 14:47:01 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 153/458] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:47:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:47:49 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_api:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:47:49 user devstack@n-api.service[61311]: DEBUG dbcounter [-] [61311] Writing DB stats nova_cell1:SELECT=4 {{(pid=61311) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:47:49 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-45e43242-20dc-4759-a41a-5506a37a14eb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:47:49 user devstack@n-api.service[61311]: DEBUG nova.compute.api [None req-45e43242-20dc-4759-a41a-5506a37a14eb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 7f3425ec-c7ad-4443-8979-00c95f4b0446] Fetching instance by UUID {{(pid=61311) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:47:49 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-45e43242-20dc-4759-a41a-5506a37a14eb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:47:49 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-45e43242-20dc-4759-a41a-5506a37a14eb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:47:49 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-45e43242-20dc-4759-a41a-5506a37a14eb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:47:49 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-45e43242-20dc-4759-a41a-5506a37a14eb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:47:49 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-45e43242-20dc-4759-a41a-5506a37a14eb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:47:49 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [None req-45e43242-20dc-4759-a41a-5506a37a14eb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:47:49 user devstack@n-api.service[61311]: INFO nova.api.openstack.wsgi [None req-45e43242-20dc-4759-a41a-5506a37a14eb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] HTTP exception thrown: Instance 7f3425ec-c7ad-4443-8979-00c95f4b0446 could not be found. Apr 18 14:47:49 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-45e43242-20dc-4759-a41a-5506a37a14eb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Request method failure captured: Apr 18 14:47:49 user devstack@n-api.service[61311]: request: GET /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446 HTTP/1.1 Apr 18 14:47:49 user devstack@n-api.service[61311]: Accept: application/json Apr 18 14:47:49 user devstack@n-api.service[61311]: Accept-Encoding: identity Apr 18 14:47:49 user devstack@n-api.service[61311]: Connection: close Apr 18 14:47:49 user devstack@n-api.service[61311]: Content-Length: 0 Apr 18 14:47:49 user devstack@n-api.service[61311]: Content-Type: application/json Apr 18 14:47:49 user devstack@n-api.service[61311]: Host: 10.0.0.210 Apr 18 14:47:49 user devstack@n-api.service[61311]: Openstack-System-Scope: None Apr 18 14:47:49 user devstack@n-api.service[61311]: User-Agent: python-urllib3/1.26.15 Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Auth-Token: gAAAAABkPquWKJBvwso4M8w_PrqFgWouKYzz98R_LdX8iNdfa-iE9UJYFZIUWX8D4yRZEVrXAeROwACDgbqMjS3DBWh518wJ3jucUKcsFu0x9ga9izvkEDvu1FvHyddvDvcXD-wa5I2LNTlPtGx0_nvmO8Y9FBYlt7eOaM2bokgvbkwt_EgFHfc Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Domain-Id: None Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Domain-Name: None Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Identity-Status: Confirmed Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Is-Admin-Project: True Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Project-Domain-Id: default Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Project-Domain-Name: Default Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Project-Id: f1bb3c50254545ff88c6bb55ccd16e7c Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-727141871 Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Role: reader,member Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Roles: reader,member Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1bb3c50254545ff88c6bb55ccd16e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1bb3c50254545ff88c6bb55ccd16e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1bb3c50254545ff88c6bb55ccd16e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-727141871 Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Tenant-Id: f1bb3c50254545ff88c6bb55ccd16e7c Apr 18 14:47:49 user devstack@n-api.service[61311]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-727141871 Apr 18 14:47:49 user devstack@n-api.service[61311]: X-User: tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member Apr 18 14:47:49 user devstack@n-api.service[61311]: X-User-Domain-Id: default Apr 18 14:47:49 user devstack@n-api.service[61311]: X-User-Domain-Name: Default Apr 18 14:47:49 user devstack@n-api.service[61311]: X-User-Id: bf32806393ed4030970e1a6e445bc43d Apr 18 14:47:49 user devstack@n-api.service[61311]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member Apr 18 14:47:49 user devstack@n-api.service[61311]: method: > Apr 18 14:47:49 user devstack@n-api.service[61311]: exception: Instance 7f3425ec-c7ad-4443-8979-00c95f4b0446 could not be found. Apr 18 14:47:49 user devstack@n-api.service[61311]: action_args: {'id': '7f3425ec-c7ad-4443-8979-00c95f4b0446'} Apr 18 14:47:49 user devstack@n-api.service[61311]: {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f3425ec-c7ad-4443-8979-00c95f4b0446 could not be found. Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f3425ec-c7ad-4443-8979-00c95f4b0446 could not be found. Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f3425ec-c7ad-4443-8979-00c95f4b0446 could not be found. Apr 18 14:47:49 user devstack@n-api.service[61311]: ERROR nova.api.openstack.wsgi Apr 18 14:47:49 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [None req-45e43242-20dc-4759-a41a-5506a37a14eb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Returning 404 to user: Instance 7f3425ec-c7ad-4443-8979-00c95f4b0446 could not be found. {{(pid=61311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:47:49 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [None req-45e43242-20dc-4759-a41a-5506a37a14eb tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446" status: 404 len: 111 microversion: 2.87 time: 0.035616 Apr 18 14:47:49 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 152/459] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:47:49 2023] GET /compute/v2.1/servers/7f3425ec-c7ad-4443-8979-00c95f4b0446 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 18 14:47:49 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:47:49 user devstack@n-api.service[61309]: DEBUG dbcounter [-] [61309] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61309) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:47:49 user devstack@n-api.service[61309]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 14:47:49 user devstack@n-api.service[61309]: Tue Apr 18 14:47:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98 (ip 10.0.0.210) !!! Apr 18 14:47:49 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [None req-2dfb444b-6704-422c-9859-0d93bb5755f9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:47:49 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-2dfb444b-6704-422c-9859-0d93bb5755f9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 149dbe97-118a-4187-b728-f71470c80e98] Fetching instance by UUID {{(pid=61309) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:47:49 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2dfb444b-6704-422c-9859-0d93bb5755f9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:47:49 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2dfb444b-6704-422c-9859-0d93bb5755f9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:47:49 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2dfb444b-6704-422c-9859-0d93bb5755f9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:47:49 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2dfb444b-6704-422c-9859-0d93bb5755f9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:47:49 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2dfb444b-6704-422c-9859-0d93bb5755f9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:47:49 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [None req-2dfb444b-6704-422c-9859-0d93bb5755f9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:47:49 user devstack@n-api.service[61309]: DEBUG nova.compute.api [None req-2dfb444b-6704-422c-9859-0d93bb5755f9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 149dbe97-118a-4187-b728-f71470c80e98] Going to try to terminate instance {{(pid=61309) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 14:47:49 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [None req-2dfb444b-6704-422c-9859-0d93bb5755f9 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98" status: 204 len: 0 microversion: 2.87 time: 0.118297 Apr 18 14:47:49 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 155/460] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 14:47:49 2023] DELETE /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 18 14:47:49 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:47:49 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:47:49 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-c24142d4-b57a-49ef-a0e9-fa9f479f3ab3 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:47:49 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-c24142d4-b57a-49ef-a0e9-fa9f479f3ab3 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 149dbe97-118a-4187-b728-f71470c80e98] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:47:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c24142d4-b57a-49ef-a0e9-fa9f479f3ab3 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:47:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c24142d4-b57a-49ef-a0e9-fa9f479f3ab3 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:47:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c24142d4-b57a-49ef-a0e9-fa9f479f3ab3 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:47:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c24142d4-b57a-49ef-a0e9-fa9f479f3ab3 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:47:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c24142d4-b57a-49ef-a0e9-fa9f479f3ab3 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:47:49 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-c24142d4-b57a-49ef-a0e9-fa9f479f3ab3 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:47:50 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-c24142d4-b57a-49ef-a0e9-fa9f479f3ab3 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:47:50 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-c24142d4-b57a-49ef-a0e9-fa9f479f3ab3 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:47:50 user devstack@n-api.service[61310]: DEBUG nova.policy [None req-c24142d4-b57a-49ef-a0e9-fa9f479f3ab3 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf32806393ed4030970e1a6e445bc43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bb3c50254545ff88c6bb55ccd16e7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61310) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 14:47:50 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-c24142d4-b57a-49ef-a0e9-fa9f479f3ab3 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98" status: 200 len: 1698 microversion: 2.87 time: 0.414987 Apr 18 14:47:50 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 154/461] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:47:49 2023] GET /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98 => generated 1698 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 14:47:50 user devstack@n-api.service[61311]: DEBUG nova.api.openstack.wsgi [req-1bcb62e1-a976-4f65-9f51-0b2f0485821a req-b5e135da-5228-4e3f-8a97-80257357e530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149dbe97-118a-4187-b728-f71470c80e98", "name": "network-vif-unplugged", "status": "completed", "tag": "424e80fe-2145-4fb2-a3e6-f4eee6965c09"}]} {{(pid=61311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:47:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-1bcb62e1-a976-4f65-9f51-0b2f0485821a req-b5e135da-5228-4e3f-8a97-80257357e530 service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:47:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-1bcb62e1-a976-4f65-9f51-0b2f0485821a req-b5e135da-5228-4e3f-8a97-80257357e530 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:47:50 user devstack@n-api.service[61311]: DEBUG oslo_concurrency.lockutils [req-1bcb62e1-a976-4f65-9f51-0b2f0485821a req-b5e135da-5228-4e3f-8a97-80257357e530 service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61311) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:47:50 user devstack@n-api.service[61311]: INFO nova.api.openstack.compute.server_external_events [req-1bcb62e1-a976-4f65-9f51-0b2f0485821a req-b5e135da-5228-4e3f-8a97-80257357e530 service nova] Creating event network-vif-unplugged:424e80fe-2145-4fb2-a3e6-f4eee6965c09 for instance 149dbe97-118a-4187-b728-f71470c80e98 on user Apr 18 14:47:50 user devstack@n-api.service[61311]: INFO nova.api.openstack.requestlog [req-1bcb62e1-a976-4f65-9f51-0b2f0485821a req-b5e135da-5228-4e3f-8a97-80257357e530 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029083 Apr 18 14:47:50 user devstack@n-api.service[61311]: [pid: 61311|app: 0|req: 153/462] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:47:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:47:52 user devstack@n-api.service[61309]: DEBUG nova.api.openstack.wsgi [req-7db0b8c9-b45d-427c-a913-10c6a79cae3a req-bb2ecf5d-3a8f-4b4f-8f85-79437a46c02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149dbe97-118a-4187-b728-f71470c80e98", "name": "network-vif-plugged", "status": "completed", "tag": "424e80fe-2145-4fb2-a3e6-f4eee6965c09"}, {"server_uuid": "149dbe97-118a-4187-b728-f71470c80e98", "name": "network-vif-deleted", "tag": "424e80fe-2145-4fb2-a3e6-f4eee6965c09"}]} {{(pid=61309) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 14:47:52 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-7db0b8c9-b45d-427c-a913-10c6a79cae3a req-bb2ecf5d-3a8f-4b4f-8f85-79437a46c02e service nova] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:47:52 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-7db0b8c9-b45d-427c-a913-10c6a79cae3a req-bb2ecf5d-3a8f-4b4f-8f85-79437a46c02e service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:47:52 user devstack@n-api.service[61309]: DEBUG oslo_concurrency.lockutils [req-7db0b8c9-b45d-427c-a913-10c6a79cae3a req-bb2ecf5d-3a8f-4b4f-8f85-79437a46c02e service nova] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61309) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:47:52 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-7db0b8c9-b45d-427c-a913-10c6a79cae3a req-bb2ecf5d-3a8f-4b4f-8f85-79437a46c02e service nova] Creating event network-vif-plugged:424e80fe-2145-4fb2-a3e6-f4eee6965c09 for instance 149dbe97-118a-4187-b728-f71470c80e98 on user Apr 18 14:47:52 user devstack@n-api.service[61309]: INFO nova.api.openstack.compute.server_external_events [req-7db0b8c9-b45d-427c-a913-10c6a79cae3a req-bb2ecf5d-3a8f-4b4f-8f85-79437a46c02e service nova] Creating event network-vif-deleted:424e80fe-2145-4fb2-a3e6-f4eee6965c09 for instance 149dbe97-118a-4187-b728-f71470c80e98 on user Apr 18 14:47:52 user devstack@n-api.service[61309]: INFO nova.api.openstack.requestlog [req-7db0b8c9-b45d-427c-a913-10c6a79cae3a req-bb2ecf5d-3a8f-4b4f-8f85-79437a46c02e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030416 Apr 18 14:47:52 user devstack@n-api.service[61309]: [pid: 61309|app: 0|req: 156/463] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 14:47:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 14:48:40 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-65a7d3b1-5e21-4068-9706-5a2ac82f9769 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Calling method '>' {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 14:48:40 user devstack@n-api.service[61310]: DEBUG nova.compute.api [None req-65a7d3b1-5e21-4068-9706-5a2ac82f9769 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] [instance: 149dbe97-118a-4187-b728-f71470c80e98] Fetching instance by UUID {{(pid=61310) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 14:48:40 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_cell1:SELECT=6 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:48:40 user devstack@n-api.service[61310]: DEBUG dbcounter [-] [61310] Writing DB stats nova_api:SELECT=4 {{(pid=61310) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 14:48:40 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-65a7d3b1-5e21-4068-9706-5a2ac82f9769 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:48:40 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-65a7d3b1-5e21-4068-9706-5a2ac82f9769 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:48:40 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-65a7d3b1-5e21-4068-9706-5a2ac82f9769 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:48:40 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-65a7d3b1-5e21-4068-9706-5a2ac82f9769 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Acquiring lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 14:48:40 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-65a7d3b1-5e21-4068-9706-5a2ac82f9769 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 14:48:40 user devstack@n-api.service[61310]: DEBUG oslo_concurrency.lockutils [None req-65a7d3b1-5e21-4068-9706-5a2ac82f9769 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Lock "337bb0b3-02d6-4a06-882a-72d8b3d786a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61310) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 14:48:40 user devstack@n-api.service[61310]: INFO nova.api.openstack.wsgi [None req-65a7d3b1-5e21-4068-9706-5a2ac82f9769 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] HTTP exception thrown: Instance 149dbe97-118a-4187-b728-f71470c80e98 could not be found. Apr 18 14:48:40 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-65a7d3b1-5e21-4068-9706-5a2ac82f9769 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Request method failure captured: Apr 18 14:48:40 user devstack@n-api.service[61310]: request: GET /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98 HTTP/1.1 Apr 18 14:48:40 user devstack@n-api.service[61310]: Accept: application/json Apr 18 14:48:40 user devstack@n-api.service[61310]: Accept-Encoding: identity Apr 18 14:48:40 user devstack@n-api.service[61310]: Connection: close Apr 18 14:48:40 user devstack@n-api.service[61310]: Content-Length: 0 Apr 18 14:48:40 user devstack@n-api.service[61310]: Content-Type: application/json Apr 18 14:48:40 user devstack@n-api.service[61310]: Host: 10.0.0.210 Apr 18 14:48:40 user devstack@n-api.service[61310]: Openstack-System-Scope: None Apr 18 14:48:40 user devstack@n-api.service[61310]: User-Agent: python-urllib3/1.26.15 Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Auth-Token: gAAAAABkPquWKJBvwso4M8w_PrqFgWouKYzz98R_LdX8iNdfa-iE9UJYFZIUWX8D4yRZEVrXAeROwACDgbqMjS3DBWh518wJ3jucUKcsFu0x9ga9izvkEDvu1FvHyddvDvcXD-wa5I2LNTlPtGx0_nvmO8Y9FBYlt7eOaM2bokgvbkwt_EgFHfc Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Domain-Id: None Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Domain-Name: None Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Identity-Status: Confirmed Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Is-Admin-Project: True Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Project-Domain-Id: default Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Project-Domain-Name: Default Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Project-Id: f1bb3c50254545ff88c6bb55ccd16e7c Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-727141871 Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Role: reader,member Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Roles: reader,member Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1bb3c50254545ff88c6bb55ccd16e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1bb3c50254545ff88c6bb55ccd16e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1bb3c50254545ff88c6bb55ccd16e7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-727141871 Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Tenant-Id: f1bb3c50254545ff88c6bb55ccd16e7c Apr 18 14:48:40 user devstack@n-api.service[61310]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-727141871 Apr 18 14:48:40 user devstack@n-api.service[61310]: X-User: tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member Apr 18 14:48:40 user devstack@n-api.service[61310]: X-User-Domain-Id: default Apr 18 14:48:40 user devstack@n-api.service[61310]: X-User-Domain-Name: Default Apr 18 14:48:40 user devstack@n-api.service[61310]: X-User-Id: bf32806393ed4030970e1a6e445bc43d Apr 18 14:48:40 user devstack@n-api.service[61310]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member Apr 18 14:48:40 user devstack@n-api.service[61310]: method: > Apr 18 14:48:40 user devstack@n-api.service[61310]: exception: Instance 149dbe97-118a-4187-b728-f71470c80e98 could not be found. Apr 18 14:48:40 user devstack@n-api.service[61310]: action_args: {'id': '149dbe97-118a-4187-b728-f71470c80e98'} Apr 18 14:48:40 user devstack@n-api.service[61310]: {{(pid=61310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149dbe97-118a-4187-b728-f71470c80e98 could not be found. Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149dbe97-118a-4187-b728-f71470c80e98 could not be found. Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149dbe97-118a-4187-b728-f71470c80e98 could not be found. Apr 18 14:48:40 user devstack@n-api.service[61310]: ERROR nova.api.openstack.wsgi Apr 18 14:48:40 user devstack@n-api.service[61310]: DEBUG nova.api.openstack.wsgi [None req-65a7d3b1-5e21-4068-9706-5a2ac82f9769 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] Returning 404 to user: Instance 149dbe97-118a-4187-b728-f71470c80e98 could not be found. {{(pid=61310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 14:48:40 user devstack@n-api.service[61310]: INFO nova.api.openstack.requestlog [None req-65a7d3b1-5e21-4068-9706-5a2ac82f9769 tempest-ServerBootFromVolumeStableRescueTest-727141871 tempest-ServerBootFromVolumeStableRescueTest-727141871-project-member] 10.0.0.210 "GET /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98" status: 404 len: 111 microversion: 2.87 time: 0.033242 Apr 18 14:48:40 user devstack@n-api.service[61310]: [pid: 61310|app: 0|req: 155/464] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 14:48:40 2023] GET /compute/v2.1/servers/149dbe97-118a-4187-b728-f71470c80e98 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0)