Apr 21 15:25:44 user devstack@n-api.service[61509]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 21 15:25:44 user devstack@n-api.service[61509]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 21 15:25:44 2023] *** Apr 21 15:25:44 user devstack@n-api.service[61509]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 21 15:25:44 user devstack@n-api.service[61509]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 21 15:25:44 user devstack@n-api.service[61509]: nodename: user Apr 21 15:25:44 user devstack@n-api.service[61509]: machine: x86_64 Apr 21 15:25:44 user devstack@n-api.service[61509]: clock source: unix Apr 21 15:25:44 user devstack@n-api.service[61509]: pcre jit disabled Apr 21 15:25:44 user devstack@n-api.service[61509]: detected number of CPU cores: 12 Apr 21 15:25:44 user devstack@n-api.service[61509]: current working directory: / Apr 21 15:25:44 user devstack@n-api.service[61509]: detected binary path: /usr/bin/uwsgi-core Apr 21 15:25:44 user devstack@n-api.service[61509]: your processes number limit is 63637 Apr 21 15:25:44 user devstack@n-api.service[61509]: your memory page size is 4096 bytes Apr 21 15:25:44 user devstack@n-api.service[61509]: detected max file descriptor number: 2048 Apr 21 15:25:44 user devstack@n-api.service[61509]: lock engine: pthread robust mutexes Apr 21 15:25:44 user devstack@n-api.service[61509]: thunder lock: enabled Apr 21 15:25:44 user devstack@n-api.service[61509]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 21 15:25:44 user devstack@n-api.service[61509]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 21 15:25:44 user devstack@n-api.service[61509]: Python main interpreter initialized at 0x55a9997b6990 Apr 21 15:25:44 user devstack@n-api.service[61509]: python threads support enabled Apr 21 15:25:44 user devstack@n-api.service[61509]: your server socket listen backlog is limited to 100 connections Apr 21 15:25:44 user devstack@n-api.service[61509]: your mercy for graceful operations on workers is 90 seconds Apr 21 15:25:44 user devstack@n-api.service[61509]: mapped 537436 bytes (524 KB) for 3 cores Apr 21 15:25:44 user devstack@n-api.service[61509]: *** Operational MODE: preforking *** Apr 21 15:25:44 user devstack@n-api.service[61509]: *** uWSGI is running in multiple interpreter mode *** Apr 21 15:25:44 user devstack@n-api.service[61509]: spawned uWSGI master process (pid: 61509) Apr 21 15:25:44 user devstack@n-api.service[61509]: spawned uWSGI worker 1 (pid: 61510, cores: 1) Apr 21 15:25:44 user devstack@n-api.service[61509]: spawned uWSGI worker 2 (pid: 61511, cores: 1) Apr 21 15:25:44 user devstack@n-api.service[61509]: spawned uWSGI worker 3 (pid: 61512, cores: 1) Apr 21 15:25:44 user devstack@n-api.service[61509]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 21 15:25:45 user devstack@n-api.service[61511]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 21 15:25:45 user devstack@n-api.service[61512]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 21 15:25:45 user devstack@n-api.service[61510]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 21 15:25:48 user devstack@n-api.service[61510]: live_migration_uri is deprecated for removal in favor of two other options that Apr 21 15:25:48 user devstack@n-api.service[61510]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 21 15:25:48 user devstack@n-api.service[61510]: and ``live_migration_inbound_addr`` respectively. Apr 21 15:25:48 user devstack@n-api.service[61510]: ). Its value may be silently ignored in the future. Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 21 15:25:48 user devstack@n-api.service[61511]: live_migration_uri is deprecated for removal in favor of two other options that Apr 21 15:25:48 user devstack@n-api.service[61511]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 21 15:25:48 user devstack@n-api.service[61511]: and ``live_migration_inbound_addr`` respectively. Apr 21 15:25:48 user devstack@n-api.service[61511]: ). Its value may be silently ignored in the future. Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 21 15:25:48 user devstack@n-api.service[61512]: live_migration_uri is deprecated for removal in favor of two other options that Apr 21 15:25:48 user devstack@n-api.service[61512]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 21 15:25:48 user devstack@n-api.service[61512]: and ``live_migration_inbound_addr`` respectively. Apr 21 15:25:48 user devstack@n-api.service[61512]: ). Its value may be silently ignored in the future. Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61510) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61511) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61512) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 21 15:25:49 user devstack@n-api.service[61510]: INFO dbcounter [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Registered counter for database nova_api Apr 21 15:25:49 user devstack@n-api.service[61511]: INFO dbcounter [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Registered counter for database nova_api Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG oslo_db.sqlalchemy.engines [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61510) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG oslo_db.sqlalchemy.engines [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61511) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writer thread running {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writer thread running {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 15:25:49 user devstack@n-api.service[61512]: INFO dbcounter [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Registered counter for database nova_api Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG nova.context [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ec9e962f-7b82-4673-844a-78caa9c9d46e(cell1) {{(pid=61511) load_cells /opt/stack/nova/nova/context.py:464}} Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:25:49 user devstack@n-api.service[61511]: INFO dbcounter [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Registered counter for database nova_cell0 Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61512) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 15:25:49 user devstack@n-api.service[61511]: INFO dbcounter [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Registered counter for database nova_cell1 Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG oslo_db.sqlalchemy.engines [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61511) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG oslo_db.sqlalchemy.engines [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61511) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG nova.context [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ec9e962f-7b82-4673-844a-78caa9c9d46e(cell1) {{(pid=61510) load_cells /opt/stack/nova/nova/context.py:464}} Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writer thread running {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:25:49 user devstack@n-api.service[61510]: INFO dbcounter [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Registered counter for database nova_cell0 Apr 21 15:25:49 user devstack@n-api.service[61510]: INFO dbcounter [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Registered counter for database nova_cell1 Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writer thread running {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG oslo_db.sqlalchemy.engines [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61510) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writer thread running {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG oslo_db.sqlalchemy.engines [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61510) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG nova.context [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ec9e962f-7b82-4673-844a-78caa9c9d46e(cell1) {{(pid=61512) load_cells /opt/stack/nova/nova/context.py:464}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writer thread running {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:25:49 user devstack@n-api.service[61512]: INFO dbcounter [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Registered counter for database nova_cell0 Apr 21 15:25:49 user devstack@n-api.service[61511]: INFO dbcounter [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Registered counter for database nova_cell0 Apr 21 15:25:49 user devstack@n-api.service[61512]: INFO dbcounter [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Registered counter for database nova_cell1 Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG oslo_db.sqlalchemy.engines [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61511) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writer thread running {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61512) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writer thread running {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writer thread running {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61512) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 15:25:49 user devstack@n-api.service[61510]: INFO dbcounter [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Registered counter for database nova_cell0 Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG oslo_db.sqlalchemy.engines [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61510) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 15:25:49 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writer thread running {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writer thread running {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 15:25:49 user devstack@n-api.service[61512]: INFO dbcounter [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Registered counter for database nova_cell0 Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61512) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 21 15:25:49 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writer thread running {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 21 15:25:49 user devstack@n-api.service[61511]: WARNING keystonemiddleware.auth_token [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 15:25:49 user devstack@n-api.service[61511]: WARNING keystonemiddleware.auth_token [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 15:25:49 user devstack@n-api.service[61512]: WARNING keystonemiddleware.auth_token [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 15:25:49 user devstack@n-api.service[61512]: WARNING keystonemiddleware.auth_token [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 15:25:49 user devstack@n-api.service[61510]: WARNING keystonemiddleware.auth_token [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 15:25:49 user devstack@n-api.service[61510]: WARNING keystonemiddleware.auth_token [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 15:25:49 user devstack@n-api.service[61511]: WARNING keystonemiddleware.auth_token [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 15:25:49 user devstack@n-api.service[61511]: WARNING keystonemiddleware.auth_token [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 15:25:49 user devstack@n-api.service[61511]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a9997b6990 pid: 61511 (default app) Apr 21 15:25:49 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:25:49 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001509 Apr 21 15:25:49 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 21 15:25:49 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:25:49 user devstack@n-api.service[61510]: WARNING keystonemiddleware.auth_token [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 15:25:49 user devstack@n-api.service[61510]: WARNING keystonemiddleware.auth_token [None req-f3f98134-6969-4541-a2e6-2d46056d8aab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 15:25:49 user devstack@n-api.service[61510]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a9997b6990 pid: 61510 (default app) Apr 21 15:25:49 user devstack@n-api.service[61512]: WARNING keystonemiddleware.auth_token [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 21 15:25:49 user devstack@n-api.service[61512]: WARNING keystonemiddleware.auth_token [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 21 15:25:49 user devstack@n-api.service[61512]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a9997b6990 pid: 61512 (default app) Apr 21 15:27:58 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:27:58 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-ea1469de-5dc7-49b8-b28a-9d971ffb1f32 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001448 Apr 21 15:27:58 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 15:27:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:27:58 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:27:58 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:27:58 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:27:58 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:27:58 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-01fd3a73-bc52-4bba-b2a8-f702c06247c3 admin admin] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:27:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-01fd3a73-bc52-4bba-b2a8-f702c06247c3 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.403157 Apr 21 15:27:58 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 21 15:27:58 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:28:00 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:00 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002280 Apr 21 15:28:00 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 15:28:00 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:28:00 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=3 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:28:00 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=3 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:28:00 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=3 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:28:00 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:28:01 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-aee701f1-3c76-4b77-8ebe-db7bba8d4a0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:01 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-aee701f1-3c76-4b77-8ebe-db7bba8d4a0d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.374860 Apr 21 15:28:01 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 15:28:00 2023] POST /compute/v2.1/flavors => generated 405 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:28:01 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-59cb8577-5893-421d-ad6e-56ec93e5e79b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:01 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-59cb8577-5893-421d-ad6e-56ec93e5e79b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046414 Apr 21 15:28:01 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 15:28:01 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:28:03 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:03 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001467 Apr 21 15:28:03 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 15:28:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:28:03 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-8cb38b1d-d8a9-482f-911b-8c7de7001ad6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds512M", "disk": 5, "ram": 512}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:03 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-8cb38b1d-d8a9-482f-911b-8c7de7001ad6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066619 Apr 21 15:28:03 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 15:28:03 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:28:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6fd6407c-51e9-43ec-8461-0810d7c13264 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-6fd6407c-51e9-43ec-8461-0810d7c13264 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026056 Apr 21 15:28:03 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 15:28:03 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:28:05 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:05 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001540 Apr 21 15:28:05 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 15:28:05 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:28:05 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-630e729f-0005-46ea-819b-c80c410208f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:05 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-630e729f-0005-46ea-819b-c80c410208f8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063020 Apr 21 15:28:05 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 15:28:05 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:28:05 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-941bdf96-8fd2-4ee1-a9d9-dfc88a9f8b10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:05 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-941bdf96-8fd2-4ee1-a9d9-dfc88a9f8b10 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035563 Apr 21 15:28:05 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 15:28:05 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:28:07 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:07 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001507 Apr 21 15:28:07 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 15:28:07 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:28:07 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-51fa9c4f-158d-4d2d-aa39-524e85ac3956 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "swap": 0}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:07 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-51fa9c4f-158d-4d2d-aa39-524e85ac3956 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068698 Apr 21 15:28:07 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 15:28:07 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:28:07 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-94ff5681-c6c5-40c5-8449-ffcc4f414b8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:07 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-94ff5681-c6c5-40c5-8449-ffcc4f414b8e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024614 Apr 21 15:28:07 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 15:28:07 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:28:09 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:09 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001595 Apr 21 15:28:09 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 15:28:09 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:28:09 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-7d72c3c0-e633-47a6-a232-aad3c0873fec admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "disk": 20, "id": "d4", "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:09 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-7d72c3c0-e633-47a6-a232-aad3c0873fec admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060824 Apr 21 15:28:09 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 15:28:09 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:28:09 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:09 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023385 Apr 21 15:28:09 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 21 15:28:09 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:28:11 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:11 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-bd2eae36-07b6-4002-b2b3-22904856c353 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001488 Apr 21 15:28:11 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 15:28:11 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:28:11 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-3ab03343-e805-4018-b9a6-f8e6cd1b92b5 admin admin] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:11 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-3ab03343-e805-4018-b9a6-f8e6cd1b92b5 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.074620 Apr 21 15:28:11 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 21 15:28:11 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:28:13 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:13 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001440 Apr 21 15:28:13 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 15:28:13 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 15:28:13 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=3 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:28:13 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=3 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:28:13 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=3 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:28:13 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=3 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:28:13 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-82427bc3-0d2e-4b1d-befd-05f9dd2b51c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:13 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-82427bc3-0d2e-4b1d-befd-05f9dd2b51c6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.375746 Apr 21 15:28:13 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 15:28:13 2023] POST /compute/v2.1/flavors => generated 400 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:28:13 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-0153f601-af66-4277-912c-ac1d4ec2627f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:13 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-0153f601-af66-4277-912c-ac1d4ec2627f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041395 Apr 21 15:28:13 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 15:28:13 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:28:15 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:15 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001334 Apr 21 15:28:15 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 15:28:15 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:28:15 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-7582743c-15d2-4940-bbac-52f7fce64e8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "vcpus": 1, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:15 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-7582743c-15d2-4940-bbac-52f7fce64e8a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.060531 Apr 21 15:28:15 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 15:28:15 2023] POST /compute/v2.1/flavors => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:28:15 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-d3f2c085-3fc0-4a71-95b3-80b840cb9cec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:15 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-d3f2c085-3fc0-4a71-95b3-80b840cb9cec admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029423 Apr 21 15:28:15 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 15:28:15 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:28:17 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:17 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001287 Apr 21 15:28:17 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 15:28:17 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:28:17 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-48d76bd6-d6e6-446b-84af-9d97d801ef5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "name": "m1.medium", "swap": 0}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:17 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-48d76bd6-d6e6-446b-84af-9d97d801ef5f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.065999 Apr 21 15:28:17 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 15:28:17 2023] POST /compute/v2.1/flavors => generated 404 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:28:17 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-72fbf163-69d4-405b-8034-9351cd011b94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:17 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-72fbf163-69d4-405b-8034-9351cd011b94 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026785 Apr 21 15:28:17 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 15:28:17 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:28:19 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:19 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001476 Apr 21 15:28:19 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 15:28:19 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 15:28:19 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-c24c0d19-0102-46f4-beda-4cf34240eae2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:19 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-c24c0d19-0102-46f4-beda-4cf34240eae2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.062682 Apr 21 15:28:19 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 15:28:19 2023] POST /compute/v2.1/flavors => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:28:19 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-f18cf8f0-72fd-4de6-8175-3c8260b80308 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:19 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-f18cf8f0-72fd-4de6-8175-3c8260b80308 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025131 Apr 21 15:28:19 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 15:28:19 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:28:21 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:21 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001339 Apr 21 15:28:21 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 21 15:28:21 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:28:21 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-6282195c-34ad-47d3-924f-f1056a86b3ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "swap": 0, "ram": 16384, "disk": 160, "id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:21 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-6282195c-34ad-47d3-924f-f1056a86b3ed admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.057849 Apr 21 15:28:21 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 21 15:28:21 2023] POST /compute/v2.1/flavors => generated 406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:28:21 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-7e2f4a73-83f5-406e-851e-5df5d31e7d01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:28:21 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-7e2f4a73-83f5-406e-851e-5df5d31e7d01 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024879 Apr 21 15:28:21 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 21 15:28:21 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:28:52 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:52 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-09ef9787-805d-4c76-a828-0aa70dfe44a2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001828 Apr 21 15:28:52 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 21 15:28:52 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:28:52 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:28:52 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-15ccac2b-1544-4206-8106-862c97f8c997 admin admin] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:28:52 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-15ccac2b-1544-4206-8106-862c97f8c997 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:28:52 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-15ccac2b-1544-4206-8106-862c97f8c997 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:28:52 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-15ccac2b-1544-4206-8106-862c97f8c997 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:28:52 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-15ccac2b-1544-4206-8106-862c97f8c997 admin admin] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:28:52 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-15ccac2b-1544-4206-8106-862c97f8c997 admin admin] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:28:52 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-15ccac2b-1544-4206-8106-862c97f8c997 admin admin] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:28:52 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-15ccac2b-1544-4206-8106-862c97f8c997 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.097116 Apr 21 15:28:52 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 21 15:28:52 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:29:24 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-7e2f4a73-83f5-406e-851e-5df5d31e7d01 admin admin] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:29:24 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-7e2f4a73-83f5-406e-851e-5df5d31e7d01 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002580 Apr 21 15:29:24 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 21 15:29:24 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:29:24 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:29:24 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-e99867eb-a510-4974-9349-6a209d6299a3 admin admin] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:29:24 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-e99867eb-a510-4974-9349-6a209d6299a3 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.068717 Apr 21 15:29:24 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 21 15:29:24 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:29:28 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-15ccac2b-1544-4206-8106-862c97f8c997 admin admin] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:29:28 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-15ccac2b-1544-4206-8106-862c97f8c997 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001473 Apr 21 15:29:28 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 21 15:29:28 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:29:28 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:29:28 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-375f6f2b-17fb-4265-9cbe-3c01217294be admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "name": "m1.nano", "os-flavor-access:is_public": true, "swap": 0, "ram": 128, "id": "42", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:29:28 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-375f6f2b-17fb-4265-9cbe-3c01217294be admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064857 Apr 21 15:29:28 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 21 15:29:28 2023] POST /compute/v2.1/flavors => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:29:28 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-32ab44e7-45bc-472d-ba0d-42146dbc8dae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:29:28 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-32ab44e7-45bc-472d-ba0d-42146dbc8dae admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026353 Apr 21 15:29:28 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 21 15:29:28 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:29:32 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-15ccac2b-1544-4206-8106-862c97f8c997 admin admin] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:29:32 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-15ccac2b-1544-4206-8106-862c97f8c997 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002398 Apr 21 15:29:32 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 21 15:29:32 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:29:32 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-dec4c997-ccd8-4e34-bb17-9f0b56bbdc2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "name": "m1.micro", "os-flavor-access:is_public": true, "swap": 0, "id": "84", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 192}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:29:32 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-dec4c997-ccd8-4e34-bb17-9f0b56bbdc2a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072778 Apr 21 15:29:32 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 21 15:29:32 2023] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:29:32 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-3fbb943e-ef0e-46c1-ba72-47d62bee6b39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:29:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-3fbb943e-ef0e-46c1-ba72-47d62bee6b39 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024525 Apr 21 15:29:32 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 21 15:29:32 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:31:43 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:31:43 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:31:43 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:31:43 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:31:43 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-3f74ec8c-d40f-4bfb-96b4-e05f53886a0c tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Action: 'create', calling method: .version_select at 0x7f0c15362290>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1401945415", "metadata": {"Type": "work"}}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:31:43 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-01587a1e-d743-42f9-9f27-039a67ee6220 tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] Action: 'create', calling method: .version_select at 0x7f0c153c1480>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1697438845"}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:31:43 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-3f74ec8c-d40f-4bfb-96b4-e05f53886a0c tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Request method failure captured: Apr 21 15:31:43 user devstack@n-api.service[61511]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 21 15:31:43 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:31:43 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:31:43 user devstack@n-api.service[61511]: Connection: close Apr 21 15:31:43 user devstack@n-api.service[61511]: Content-Length: 122 Apr 21 15:31:43 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:31:43 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:31:43 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:31:43 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQqxfrcpQ78YCqJqMXBH-tkv6icWPCutNbXWjX2_PGtFCgHSGULtaCupHO4QCE1Q8GH-3ZPb_ZdY5JtDsuuzhO3FOABuLWPYWFfeJB2PNg9RatTlIB0wOOaXksJkOJ1awiSys53GI4vN32cr6_k5K5kM5c5RHY3WpAOcMt8da7AM7gD8 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Project-Id: 7a7e5460917e439588502e7fb035f8f6 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Project-Name: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Tenant: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Tenant-Id: 7a7e5460917e439588502e7fb035f8f6 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-User: tempest-VolumesNegativeTest-735870475-project-member Apr 21 15:31:43 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:31:43 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:31:43 user devstack@n-api.service[61511]: X-User-Id: 73a4681cdebd4d038120ef0fc274c42f Apr 21 15:31:43 user devstack@n-api.service[61511]: X-User-Name: tempest-VolumesNegativeTest-735870475-project-member Apr 21 15:31:43 user devstack@n-api.service[61511]: Apr 21 15:31:43 user devstack@n-api.service[61511]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1401945415", "metadata": {"Type": "work"}}} Apr 21 15:31:43 user devstack@n-api.service[61511]: method: Apr 21 15:31:43 user devstack@n-api.service[61511]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 21 15:31:43 user devstack@n-api.service[61511]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1401945415', 'metadata': {'Type': 'work'}}}} Apr 21 15:31:43 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise error Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi '#$%' Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-3f74ec8c-d40f-4bfb-96b4-e05f53886a0c tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:31:43 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-3f74ec8c-d40f-4bfb-96b4-e05f53886a0c tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.151985 Apr 21 15:31:43 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 17/46] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 21 15:31:43 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 15:31:43 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:31:43 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-db5d6d93-c54f-4128-86f8-63b35e03a587 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Action: 'create', calling method: .version_select at 0x7f0c1533ee60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-116501852", "metadata": {"Type": "work"}}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:31:43 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-db5d6d93-c54f-4128-86f8-63b35e03a587 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Request method failure captured: Apr 21 15:31:43 user devstack@n-api.service[61510]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 21 15:31:43 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:31:43 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:31:43 user devstack@n-api.service[61510]: Connection: close Apr 21 15:31:43 user devstack@n-api.service[61510]: Content-Length: 119 Apr 21 15:31:43 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:31:43 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:31:43 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:31:43 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqxfrcpQ78YCqJqMXBH-tkv6icWPCutNbXWjX2_PGtFCgHSGULtaCupHO4QCE1Q8GH-3ZPb_ZdY5JtDsuuzhO3FOABuLWPYWFfeJB2PNg9RatTlIB0wOOaXksJkOJ1awiSys53GI4vN32cr6_k5K5kM5c5RHY3WpAOcMt8da7AM7gD8 Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Project-Id: 7a7e5460917e439588502e7fb035f8f6 Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Project-Name: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Tenant: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Tenant-Id: 7a7e5460917e439588502e7fb035f8f6 Apr 21 15:31:43 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:43 user devstack@n-api.service[61510]: X-User: tempest-VolumesNegativeTest-735870475-project-member Apr 21 15:31:43 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:31:43 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:31:43 user devstack@n-api.service[61510]: X-User-Id: 73a4681cdebd4d038120ef0fc274c42f Apr 21 15:31:43 user devstack@n-api.service[61510]: X-User-Name: tempest-VolumesNegativeTest-735870475-project-member Apr 21 15:31:43 user devstack@n-api.service[61510]: Apr 21 15:31:43 user devstack@n-api.service[61510]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-116501852", "metadata": {"Type": "work"}}} Apr 21 15:31:43 user devstack@n-api.service[61510]: method: Apr 21 15:31:43 user devstack@n-api.service[61510]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 21 15:31:43 user devstack@n-api.service[61510]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-116501852', 'metadata': {'Type': 'work'}}}} Apr 21 15:31:43 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise error Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi '0' Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 21 15:31:43 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-db5d6d93-c54f-4128-86f8-63b35e03a587 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:31:43 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-db5d6d93-c54f-4128-86f8-63b35e03a587 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020123 Apr 21 15:31:43 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 16/47] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 21 15:31:43 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 15:31:43 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-68a2441f-adc9-4def-935b-8e9fc45365ea tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Action: 'create', calling method: .version_select at 0x7f0c15362050>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-153308695", "metadata": {"Type": "work"}}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:31:43 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-68a2441f-adc9-4def-935b-8e9fc45365ea tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Request method failure captured: Apr 21 15:31:43 user devstack@n-api.service[61511]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 21 15:31:43 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:31:43 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:31:43 user devstack@n-api.service[61511]: Connection: close Apr 21 15:31:43 user devstack@n-api.service[61511]: Content-Length: 118 Apr 21 15:31:43 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:31:43 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:31:43 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:31:43 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQqxfrcpQ78YCqJqMXBH-tkv6icWPCutNbXWjX2_PGtFCgHSGULtaCupHO4QCE1Q8GH-3ZPb_ZdY5JtDsuuzhO3FOABuLWPYWFfeJB2PNg9RatTlIB0wOOaXksJkOJ1awiSys53GI4vN32cr6_k5K5kM5c5RHY3WpAOcMt8da7AM7gD8 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Project-Id: 7a7e5460917e439588502e7fb035f8f6 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Project-Name: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Tenant: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Tenant-Id: 7a7e5460917e439588502e7fb035f8f6 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:43 user devstack@n-api.service[61511]: X-User: tempest-VolumesNegativeTest-735870475-project-member Apr 21 15:31:43 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:31:43 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:31:43 user devstack@n-api.service[61511]: X-User-Id: 73a4681cdebd4d038120ef0fc274c42f Apr 21 15:31:43 user devstack@n-api.service[61511]: X-User-Name: tempest-VolumesNegativeTest-735870475-project-member Apr 21 15:31:43 user devstack@n-api.service[61511]: Apr 21 15:31:43 user devstack@n-api.service[61511]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-153308695", "metadata": {"Type": "work"}}} Apr 21 15:31:43 user devstack@n-api.service[61511]: method: Apr 21 15:31:43 user devstack@n-api.service[61511]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 21 15:31:43 user devstack@n-api.service[61511]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-153308695', 'metadata': {'Type': 'work'}}}} Apr 21 15:31:43 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise error Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi '' Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 21 15:31:43 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:31:43 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-68a2441f-adc9-4def-935b-8e9fc45365ea tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:31:43 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-68a2441f-adc9-4def-935b-8e9fc45365ea tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010223 Apr 21 15:31:43 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 18/48] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 21 15:31:43 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 21 15:31:43 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-148ea8e3-d27f-4b80-bfcd-da82167c90e1 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Calling method '.version_select at 0x7f0c1533d5a0>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:31:44 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-01587a1e-d743-42f9-9f27-039a67ee6220 tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.302763 Apr 21 15:31:44 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 15/49] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 21 15:31:43 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 1306 msecs (HTTP/1.1 200) 10 headers in 447 bytes (2 switches on core 0) Apr 21 15:31:44 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-fec15957-d1b9-4a53-ba16-e98e9b439299 tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] Calling method '.version_select at 0x7f0c153639a0>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:31:44 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-fec15957-d1b9-4a53-ba16-e98e9b439299 tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c741ab66-fe30-4cb9-b31c-e116de7d8b1b" status: 200 len: 342 microversion: 2.1 time: 0.241272 Apr 21 15:31:44 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 19/50] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 15:31:44 2023] GET /compute/v2.1/os-volumes/c741ab66-fe30-4cb9-b31c-e116de7d8b1b => generated 342 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:31:44 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-148ea8e3-d27f-4b80-bfcd-da82167c90e1 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] HTTP exception thrown: Volume tempest-invalid-2135601671 could not be found. Apr 21 15:31:44 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-148ea8e3-d27f-4b80-bfcd-da82167c90e1 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Request method failure captured: Apr 21 15:31:44 user devstack@n-api.service[61510]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2135601671 HTTP/1.1 Apr 21 15:31:44 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:31:44 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:31:44 user devstack@n-api.service[61510]: Connection: close Apr 21 15:31:44 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:31:44 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:31:44 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:31:44 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:31:44 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqxfrcpQ78YCqJqMXBH-tkv6icWPCutNbXWjX2_PGtFCgHSGULtaCupHO4QCE1Q8GH-3ZPb_ZdY5JtDsuuzhO3FOABuLWPYWFfeJB2PNg9RatTlIB0wOOaXksJkOJ1awiSys53GI4vN32cr6_k5K5kM5c5RHY3WpAOcMt8da7AM7gD8 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Project-Id: 7a7e5460917e439588502e7fb035f8f6 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Project-Name: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Tenant: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Tenant-Id: 7a7e5460917e439588502e7fb035f8f6 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-User: tempest-VolumesNegativeTest-735870475-project-member Apr 21 15:31:44 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:31:44 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:31:44 user devstack@n-api.service[61510]: X-User-Id: 73a4681cdebd4d038120ef0fc274c42f Apr 21 15:31:44 user devstack@n-api.service[61510]: X-User-Name: tempest-VolumesNegativeTest-735870475-project-member Apr 21 15:31:44 user devstack@n-api.service[61510]: method: Apr 21 15:31:44 user devstack@n-api.service[61510]: exception: Volume tempest-invalid-2135601671 could not be found. Apr 21 15:31:44 user devstack@n-api.service[61510]: action_args: {'id': 'tempest-invalid-2135601671'} Apr 21 15:31:44 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2135601671 could not be found. (HTTP 404) (Request-ID: req-23e4c515-3321-41fc-a8be-b6ecb51fbce9) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2135601671 could not be found. Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2135601671 could not be found. Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2135601671 could not be found. Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-148ea8e3-d27f-4b80-bfcd-da82167c90e1 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Returning 404 to user: Volume tempest-invalid-2135601671 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:31:44 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-148ea8e3-d27f-4b80-bfcd-da82167c90e1 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2135601671" status: 404 len: 99 microversion: 2.1 time: 1.233147 Apr 21 15:31:44 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 15:31:43 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-2135601671 => generated 99 bytes in 1234 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 21 15:31:44 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-3620a984-db8f-4cbc-ad2b-19263e7fec19 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005251 Apr 21 15:31:44 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 16/52] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 21 15:31:44 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 21 15:31:44 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-e41132f0-eea9-43dd-a157-a23c0cd41546 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004946 Apr 21 15:31:44 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 20/53] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 21 15:31:44 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 21 15:31:44 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-12d00c2a-1eb5-47c6-b1d1-63b44e635a08 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Calling method '.version_select at 0x7f0c15258c10>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:31:44 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-12d00c2a-1eb5-47c6-b1d1-63b44e635a08 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] HTTP exception thrown: Volume 16c0200c-771e-4972-891b-37adda3c7521 could not be found. Apr 21 15:31:44 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-12d00c2a-1eb5-47c6-b1d1-63b44e635a08 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Request method failure captured: Apr 21 15:31:44 user devstack@n-api.service[61510]: request: DELETE /compute/v2.1/os-volumes/16c0200c-771e-4972-891b-37adda3c7521 HTTP/1.1 Apr 21 15:31:44 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:31:44 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:31:44 user devstack@n-api.service[61510]: Connection: close Apr 21 15:31:44 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:31:44 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:31:44 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:31:44 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:31:44 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqxfrcpQ78YCqJqMXBH-tkv6icWPCutNbXWjX2_PGtFCgHSGULtaCupHO4QCE1Q8GH-3ZPb_ZdY5JtDsuuzhO3FOABuLWPYWFfeJB2PNg9RatTlIB0wOOaXksJkOJ1awiSys53GI4vN32cr6_k5K5kM5c5RHY3WpAOcMt8da7AM7gD8 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Project-Id: 7a7e5460917e439588502e7fb035f8f6 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Project-Name: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Tenant: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Tenant-Id: 7a7e5460917e439588502e7fb035f8f6 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:44 user devstack@n-api.service[61510]: X-User: tempest-VolumesNegativeTest-735870475-project-member Apr 21 15:31:44 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:31:44 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:31:44 user devstack@n-api.service[61510]: X-User-Id: 73a4681cdebd4d038120ef0fc274c42f Apr 21 15:31:44 user devstack@n-api.service[61510]: X-User-Name: tempest-VolumesNegativeTest-735870475-project-member Apr 21 15:31:44 user devstack@n-api.service[61510]: method: Apr 21 15:31:44 user devstack@n-api.service[61510]: exception: Volume 16c0200c-771e-4972-891b-37adda3c7521 could not be found. Apr 21 15:31:44 user devstack@n-api.service[61510]: action_args: {'id': '16c0200c-771e-4972-891b-37adda3c7521'} Apr 21 15:31:44 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 16c0200c-771e-4972-891b-37adda3c7521 could not be found. (HTTP 404) (Request-ID: req-06e991bc-b5c9-4375-93d4-527aad7a3a5a) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 16c0200c-771e-4972-891b-37adda3c7521 could not be found. Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 16c0200c-771e-4972-891b-37adda3c7521 could not be found. Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 16c0200c-771e-4972-891b-37adda3c7521 could not be found. Apr 21 15:31:44 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-12d00c2a-1eb5-47c6-b1d1-63b44e635a08 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Returning 404 to user: Volume 16c0200c-771e-4972-891b-37adda3c7521 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:31:44 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-12d00c2a-1eb5-47c6-b1d1-63b44e635a08 tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/16c0200c-771e-4972-891b-37adda3c7521" status: 404 len: 109 microversion: 2.1 time: 0.093696 Apr 21 15:31:44 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 15:31:44 2023] DELETE /compute/v2.1/os-volumes/16c0200c-771e-4972-891b-37adda3c7521 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:31:44 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-d855be39-3b2f-4d4a-97fb-ac55cfbc9beb tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Calling method '.version_select at 0x7f0c1524b250>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:31:44 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-d855be39-3b2f-4d4a-97fb-ac55cfbc9beb tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] HTTP exception thrown: Volume 757889d7-9955-436c-ae5e-c721960963fd could not be found. Apr 21 15:31:44 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-d855be39-3b2f-4d4a-97fb-ac55cfbc9beb tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Request method failure captured: Apr 21 15:31:44 user devstack@n-api.service[61512]: request: GET /compute/v2.1/os-volumes/757889d7-9955-436c-ae5e-c721960963fd HTTP/1.1 Apr 21 15:31:44 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:31:44 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:31:44 user devstack@n-api.service[61512]: Connection: close Apr 21 15:31:44 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:31:44 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:31:44 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:31:44 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:31:44 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQqxfrcpQ78YCqJqMXBH-tkv6icWPCutNbXWjX2_PGtFCgHSGULtaCupHO4QCE1Q8GH-3ZPb_ZdY5JtDsuuzhO3FOABuLWPYWFfeJB2PNg9RatTlIB0wOOaXksJkOJ1awiSys53GI4vN32cr6_k5K5kM5c5RHY3WpAOcMt8da7AM7gD8 Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Project-Id: 7a7e5460917e439588502e7fb035f8f6 Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Project-Name: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a7e5460917e439588502e7fb035f8f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Tenant: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Tenant-Id: 7a7e5460917e439588502e7fb035f8f6 Apr 21 15:31:44 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-VolumesNegativeTest-735870475 Apr 21 15:31:44 user devstack@n-api.service[61512]: X-User: tempest-VolumesNegativeTest-735870475-project-member Apr 21 15:31:44 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:31:44 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:31:44 user devstack@n-api.service[61512]: X-User-Id: 73a4681cdebd4d038120ef0fc274c42f Apr 21 15:31:44 user devstack@n-api.service[61512]: X-User-Name: tempest-VolumesNegativeTest-735870475-project-member Apr 21 15:31:44 user devstack@n-api.service[61512]: method: Apr 21 15:31:44 user devstack@n-api.service[61512]: exception: Volume 757889d7-9955-436c-ae5e-c721960963fd could not be found. Apr 21 15:31:44 user devstack@n-api.service[61512]: action_args: {'id': '757889d7-9955-436c-ae5e-c721960963fd'} Apr 21 15:31:44 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 757889d7-9955-436c-ae5e-c721960963fd could not be found. (HTTP 404) (Request-ID: req-1f5c4115-011b-40a7-901e-e0d89fea2e55) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 757889d7-9955-436c-ae5e-c721960963fd could not be found. Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 757889d7-9955-436c-ae5e-c721960963fd could not be found. Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 757889d7-9955-436c-ae5e-c721960963fd could not be found. Apr 21 15:31:44 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:44 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-d855be39-3b2f-4d4a-97fb-ac55cfbc9beb tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] Returning 404 to user: Volume 757889d7-9955-436c-ae5e-c721960963fd could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:31:44 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-d855be39-3b2f-4d4a-97fb-ac55cfbc9beb tempest-VolumesNegativeTest-735870475 tempest-VolumesNegativeTest-735870475-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/757889d7-9955-436c-ae5e-c721960963fd" status: 404 len: 109 microversion: 2.1 time: 0.038100 Apr 21 15:31:44 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 17/55] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 15:31:44 2023] GET /compute/v2.1/os-volumes/757889d7-9955-436c-ae5e-c721960963fd => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:31:45 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-c883e91a-6276-4850-924e-1ec125620005 tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] Calling method '.version_select at 0x7f0c15234c10>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:31:45 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-c883e91a-6276-4850-924e-1ec125620005 tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c741ab66-fe30-4cb9-b31c-e116de7d8b1b" status: 200 len: 342 microversion: 2.1 time: 0.055238 Apr 21 15:31:45 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 21/56] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 15:31:45 2023] GET /compute/v2.1/os-volumes/c741ab66-fe30-4cb9-b31c-e116de7d8b1b => generated 342 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:31:45 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c2323b21-841f-4547-bea0-66223a93f659 tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] Calling method '.version_select at 0x7f0c15258e50>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:31:45 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c2323b21-841f-4547-bea0-66223a93f659 tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/c741ab66-fe30-4cb9-b31c-e116de7d8b1b" status: 202 len: 0 microversion: 2.1 time: 0.195797 Apr 21 15:31:45 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 15:31:45 2023] DELETE /compute/v2.1/os-volumes/c741ab66-fe30-4cb9-b31c-e116de7d8b1b => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:31:45 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-ea933f9c-0623-4bf3-8e8c-d715e1c76ebb tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] Calling method '.version_select at 0x7f0c152b0790>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:31:46 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-ea933f9c-0623-4bf3-8e8c-d715e1c76ebb tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] HTTP exception thrown: Volume c741ab66-fe30-4cb9-b31c-e116de7d8b1b could not be found. Apr 21 15:31:46 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-ea933f9c-0623-4bf3-8e8c-d715e1c76ebb tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] Request method failure captured: Apr 21 15:31:46 user devstack@n-api.service[61512]: request: GET /compute/v2.1/os-volumes/c741ab66-fe30-4cb9-b31c-e116de7d8b1b HTTP/1.1 Apr 21 15:31:46 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:31:46 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:31:46 user devstack@n-api.service[61512]: Connection: close Apr 21 15:31:46 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:31:46 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:31:46 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:31:46 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:31:46 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQqxfQu6vNfRK-NpEVJDe0Zjg44wJf8PbRyprZhqGReR-Y_OIVagXfdLmCRNXmvy3kdjBGJto8SOJ3ZIgJ6lghDIK3RgmO-ZimOS4x2vIPNqt8N32-2R-dSn_2yU4p9x9oKofX_dlxiPrONPJs3PCMzey3dUesNlOdhwOPpLg16SU5-Q Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Project-Id: 613bba8ed28b4692866c400ece471399 Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1824801877 Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/613bba8ed28b4692866c400ece471399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/613bba8ed28b4692866c400ece471399"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/613bba8ed28b4692866c400ece471399"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1824801877 Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Tenant-Id: 613bba8ed28b4692866c400ece471399 Apr 21 15:31:46 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1824801877 Apr 21 15:31:46 user devstack@n-api.service[61512]: X-User: tempest-VolumesSnapshotsTestJSON-1824801877-project-member Apr 21 15:31:46 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:31:46 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:31:46 user devstack@n-api.service[61512]: X-User-Id: 4085981ffca144e4b0f14de33d924900 Apr 21 15:31:46 user devstack@n-api.service[61512]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1824801877-project-member Apr 21 15:31:46 user devstack@n-api.service[61512]: method: Apr 21 15:31:46 user devstack@n-api.service[61512]: exception: Volume c741ab66-fe30-4cb9-b31c-e116de7d8b1b could not be found. Apr 21 15:31:46 user devstack@n-api.service[61512]: action_args: {'id': 'c741ab66-fe30-4cb9-b31c-e116de7d8b1b'} Apr 21 15:31:46 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c741ab66-fe30-4cb9-b31c-e116de7d8b1b could not be found. (HTTP 404) (Request-ID: req-30040db1-ecd3-4f5e-a540-f9364d538966) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c741ab66-fe30-4cb9-b31c-e116de7d8b1b could not be found. Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c741ab66-fe30-4cb9-b31c-e116de7d8b1b could not be found. Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c741ab66-fe30-4cb9-b31c-e116de7d8b1b could not be found. Apr 21 15:31:46 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:31:46 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-ea933f9c-0623-4bf3-8e8c-d715e1c76ebb tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] Returning 404 to user: Volume c741ab66-fe30-4cb9-b31c-e116de7d8b1b could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:31:46 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-ea933f9c-0623-4bf3-8e8c-d715e1c76ebb tempest-VolumesSnapshotsTestJSON-1824801877 tempest-VolumesSnapshotsTestJSON-1824801877-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c741ab66-fe30-4cb9-b31c-e116de7d8b1b" status: 404 len: 109 microversion: 2.1 time: 0.037883 Apr 21 15:31:46 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 18/58] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 15:31:45 2023] GET /compute/v2.1/os-volumes/c741ab66-fe30-4cb9-b31c-e116de7d8b1b => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:32:01 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-993087559", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:01 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] validate_networks() for [('f4bf0397-f262-4f68-b326-004171149455', None, None, None, None, None)] {{(pid=61511) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:32:01 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1768348623", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "networks": [{"uuid": "a0d474c3-f7e5-4303-9474-d7483852bc0e"}]}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:01 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] validate_networks() for [('a0d474c3-f7e5-4303-9474-d7483852bc0e', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:32:02 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1248683995", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "networks": [{"uuid": "1bfd83bb-0627-4c32-b822-d0c4d69ca826"}]}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:03 user devstack@n-api.service[61512]: DEBUG nova.network.neutron [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] validate_networks() for [('1bfd83bb-0627-4c32-b822-d0c4d69ca826', None, None, None, None, None)] {{(pid=61512) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Flavor limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Image limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Flavor pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Image pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Getting quotas for project 9caeb7a6f3674392afae6edf987420fa. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Getting quotas for user fc4e5168c1014774b77090a1eeb56abf and project 9caeb7a6f3674392afae6edf987420fa. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Going to run 1 instances... {{(pid=61511) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 2da62263-7d42-447d-abee-597a75abb16f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:32:03 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-a0b78209-5c84-405a-8b60-fc0802fc7a27 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.119765 Apr 21 15:32:03 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 22/59] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:32:01 2023] POST /compute/v2.1/servers => generated 381 bytes in 2121 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-9b77b557-d950-4752-8d1a-ecf02334cd81 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-9b77b557-d950-4752-8d1a-ecf02334cd81 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 2da62263-7d42-447d-abee-597a75abb16f] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-9b77b557-d950-4752-8d1a-ecf02334cd81 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e5168c1014774b77090a1eeb56abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9caeb7a6f3674392afae6edf987420fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:03 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-9b77b557-d950-4752-8d1a-ecf02334cd81 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2da62263-7d42-447d-abee-597a75abb16f" status: 200 len: 1215 microversion: 2.1 time: 0.200344 Apr 21 15:32:03 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 23/60] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:32:03 2023] GET /compute/v2.1/servers/2da62263-7d42-447d-abee-597a75abb16f => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1029386371", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:03 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] validate_networks() for [('f4bf0397-f262-4f68-b326-004171149455', None, None, None, None, None)] {{(pid=61511) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Getting quotas for project c6a34de8879c43bcb72b8eb70df45700. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Getting quotas for user a9c07c4b2ee5404db0ad5e5126dcdfb5 and project c6a34de8879c43bcb72b8eb70df45700. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: e948aeec-acfe-4862-8f6a-28e02c05c46c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:32:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f591e19b-70ac-454f-a4aa-b9d538c29633 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.948926 Apr 21 15:32:04 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 20/61] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:32:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 2950 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-fdeeadee-20d1-46dd-b65b-22c10a0cc18c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-fdeeadee-20d1-46dd-b65b-22c10a0cc18c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: e948aeec-acfe-4862-8f6a-28e02c05c46c] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-fdeeadee-20d1-46dd-b65b-22c10a0cc18c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c07c4b2ee5404db0ad5e5126dcdfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a34de8879c43bcb72b8eb70df45700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Flavor limits 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Image limits 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Flavor pref 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Image pref 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:32:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-fdeeadee-20d1-46dd-b65b-22c10a0cc18c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c" status: 200 len: 1211 microversion: 2.1 time: 0.163326 Apr 21 15:32:04 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 21/62] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:32:04 2023] GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c => generated 1211 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Getting quotas for project 80135d0f2158413da39596602a3cdc02. Resources: {'ram', 'cores', 'instances'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Getting quotas for user 06bf99010b5f45f2bfb834e3d6bb7f33 and project 80135d0f2158413da39596602a3cdc02. Resources: {'ram', 'cores', 'instances'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Going to run 1 instances... {{(pid=61512) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:32:04 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] [instance: ab4f24f3-2688-4a47-938b-947b30c3694a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:32:04 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-a038ff10-3c97-474c-946a-11de15b4b5bb tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.373209 Apr 21 15:32:04 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 19/63] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:32:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 2375 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-67c13387-bf70-43e1-97fd-0def94d9d55e tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:32:04 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-67c13387-bf70-43e1-97fd-0def94d9d55e tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] [instance: ab4f24f3-2688-4a47-938b-947b30c3694a] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:32:05 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-67c13387-bf70-43e1-97fd-0def94d9d55e tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06bf99010b5f45f2bfb834e3d6bb7f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80135d0f2158413da39596602a3cdc02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:05 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-67c13387-bf70-43e1-97fd-0def94d9d55e tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab4f24f3-2688-4a47-938b-947b30c3694a" status: 200 len: 1209 microversion: 2.1 time: 0.148931 Apr 21 15:32:05 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 22/64] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:32:04 2023] GET /compute/v2.1/servers/ab4f24f3-2688-4a47-938b-947b30c3694a => generated 1209 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Flavor limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Image limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Flavor pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Image pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Getting quotas for project 9caeb7a6f3674392afae6edf987420fa. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Getting quotas for user fc4e5168c1014774b77090a1eeb56abf and project 9caeb7a6f3674392afae6edf987420fa. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Going to run 1 instances... {{(pid=61511) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:32:05 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 662c333c-a6b4-4fec-90e5-3712fbebfc4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:32:05 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-e7f4c3cf-b143-47ae-8d2e-26dec6318933 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.784281 Apr 21 15:32:05 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 24/65] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:32:03 2023] POST /compute/v2.1/servers => generated 381 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:32:05 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-66a29b99-3d86-44bc-b594-9ab116b61203 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:32:05 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-66a29b99-3d86-44bc-b594-9ab116b61203 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 662c333c-a6b4-4fec-90e5-3712fbebfc4d] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:32:05 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-66a29b99-3d86-44bc-b594-9ab116b61203 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e5168c1014774b77090a1eeb56abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9caeb7a6f3674392afae6edf987420fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:05 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-66a29b99-3d86-44bc-b594-9ab116b61203 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d" status: 200 len: 1216 microversion: 2.1 time: 0.115114 Apr 21 15:32:05 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 20/66] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:32:05 2023] GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d => generated 1216 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-e191146d-606a-4693-80bd-7d5639339fc7 req-4b79551f-739f-4c24-8996-62098b15c631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da62263-7d42-447d-abee-597a75abb16f", "tag": "37a7d258-7421-45a2-a4ba-5efa8c64120d"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e191146d-606a-4693-80bd-7d5639339fc7 req-4b79551f-739f-4c24-8996-62098b15c631 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e191146d-606a-4693-80bd-7d5639339fc7 req-4b79551f-739f-4c24-8996-62098b15c631 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e191146d-606a-4693-80bd-7d5639339fc7 req-4b79551f-739f-4c24-8996-62098b15c631 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:11 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-e191146d-606a-4693-80bd-7d5639339fc7 req-4b79551f-739f-4c24-8996-62098b15c631 service nova] Creating event network-changed:37a7d258-7421-45a2-a4ba-5efa8c64120d for instance 2da62263-7d42-447d-abee-597a75abb16f on user Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e191146d-606a-4693-80bd-7d5639339fc7 req-4b79551f-739f-4c24-8996-62098b15c631 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61510) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e191146d-606a-4693-80bd-7d5639339fc7 req-4b79551f-739f-4c24-8996-62098b15c631 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61510) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1136e823-a043-4031-b9fb-8c332a513885 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1136e823-a043-4031-b9fb-8c332a513885 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1136e823-a043-4031-b9fb-8c332a513885 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1136e823-a043-4031-b9fb-8c332a513885 None None] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1136e823-a043-4031-b9fb-8c332a513885 None None] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1136e823-a043-4031-b9fb-8c332a513885 None None] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:11 user devstack@n-api.service[61510]: INFO nova.compute.rpcapi [None req-1136e823-a043-4031-b9fb-8c332a513885 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 21 15:32:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1136e823-a043-4031-b9fb-8c332a513885 None None] Releasing lock "compute-rpcapi-router" {{(pid=61510) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 21 15:32:11 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-1136e823-a043-4031-b9fb-8c332a513885 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141970 Apr 21 15:32:11 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 23/67] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:12 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-aafa5983-79b3-46fb-8371-ad52667bad1b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Action: 'create', calling method: .version_select at 0x7f0c152f2290>, body: {"keypair": {"name": "tempest-keypair-520324050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjkZ4ItcUmpXrP10bLq40xDLRnrAZ+umDYUW1ale426EwzCZShdPta1OBFkX0h6SQLeW3wHgeV6iokqcBLiGmgVspeIeC+cU2Pd6+TrAiTEi0sCi6DogJYnay+75UR9vg=="}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:12 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-aafa5983-79b3-46fb-8371-ad52667bad1b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Getting quotas for project 9de04c4cc5f140c08c23e34065a9b59a. Resources: {'key_pairs'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:32:12 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-aafa5983-79b3-46fb-8371-ad52667bad1b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Getting quotas for user 27b6dad090b84d0d9b0a8c3f6421a4b0 and project 9de04c4cc5f140c08c23e34065a9b59a. Resources: {'key_pairs'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:32:12 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-aafa5983-79b3-46fb-8371-ad52667bad1b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151517 Apr 21 15:32:12 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 25/68] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:32:12 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-c00f31c7-84b5-49bf-86e8-6dcfffd5f538 req-a29951bc-ab82-4137-bd42-2edff275a1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e948aeec-acfe-4862-8f6a-28e02c05c46c", "tag": "f3eeb5a5-1272-48ef-a96f-fe7cdc2fcbb6"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-c00f31c7-84b5-49bf-86e8-6dcfffd5f538 req-a29951bc-ab82-4137-bd42-2edff275a1e3 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-c00f31c7-84b5-49bf-86e8-6dcfffd5f538 req-a29951bc-ab82-4137-bd42-2edff275a1e3 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-c00f31c7-84b5-49bf-86e8-6dcfffd5f538 req-a29951bc-ab82-4137-bd42-2edff275a1e3 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-982285426", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "networks": [{"uuid": "d9985060-7ec3-46f0-88bf-4d31d3a04bb5"}]}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:12 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-c00f31c7-84b5-49bf-86e8-6dcfffd5f538 req-a29951bc-ab82-4137-bd42-2edff275a1e3 service nova] Creating event network-changed:f3eeb5a5-1272-48ef-a96f-fe7cdc2fcbb6 for instance e948aeec-acfe-4862-8f6a-28e02c05c46c on user Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-c00f31c7-84b5-49bf-86e8-6dcfffd5f538 req-a29951bc-ab82-4137-bd42-2edff275a1e3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61512) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-c00f31c7-84b5-49bf-86e8-6dcfffd5f538 req-a29951bc-ab82-4137-bd42-2edff275a1e3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61512) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-82331134-59fd-438d-84e5-9de8ad067ce6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-82331134-59fd-438d-84e5-9de8ad067ce6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-82331134-59fd-438d-84e5-9de8ad067ce6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-82331134-59fd-438d-84e5-9de8ad067ce6 None None] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-82331134-59fd-438d-84e5-9de8ad067ce6 None None] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-82331134-59fd-438d-84e5-9de8ad067ce6 None None] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:12 user devstack@n-api.service[61512]: INFO nova.compute.rpcapi [None req-82331134-59fd-438d-84e5-9de8ad067ce6 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 21 15:32:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-82331134-59fd-438d-84e5-9de8ad067ce6 None None] Releasing lock "compute-rpcapi-router" {{(pid=61512) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 21 15:32:12 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-82331134-59fd-438d-84e5-9de8ad067ce6 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147301 Apr 21 15:32:12 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 21/69] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:13 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] validate_networks() for [('d9985060-7ec3-46f0-88bf-4d31d3a04bb5', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-e6ec930d-bfaf-4ee1-bfe8-ebb20e790351 req-47a7a627-c50c-43d2-81bb-d28e50155814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab4f24f3-2688-4a47-938b-947b30c3694a", "tag": "a19ea3f0-2f6a-4bf6-b6af-b96310946d75"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e6ec930d-bfaf-4ee1-bfe8-ebb20e790351 req-47a7a627-c50c-43d2-81bb-d28e50155814 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e6ec930d-bfaf-4ee1-bfe8-ebb20e790351 req-47a7a627-c50c-43d2-81bb-d28e50155814 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e6ec930d-bfaf-4ee1-bfe8-ebb20e790351 req-47a7a627-c50c-43d2-81bb-d28e50155814 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:13 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-e6ec930d-bfaf-4ee1-bfe8-ebb20e790351 req-47a7a627-c50c-43d2-81bb-d28e50155814 service nova] Creating event network-changed:a19ea3f0-2f6a-4bf6-b6af-b96310946d75 for instance ab4f24f3-2688-4a47-938b-947b30c3694a on user Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e6ec930d-bfaf-4ee1-bfe8-ebb20e790351 req-47a7a627-c50c-43d2-81bb-d28e50155814 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61511) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e6ec930d-bfaf-4ee1-bfe8-ebb20e790351 req-47a7a627-c50c-43d2-81bb-d28e50155814 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61511) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-88bafa80-7b83-4ad8-895e-22e585580f68 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-88bafa80-7b83-4ad8-895e-22e585580f68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-88bafa80-7b83-4ad8-895e-22e585580f68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-88bafa80-7b83-4ad8-895e-22e585580f68 None None] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-88bafa80-7b83-4ad8-895e-22e585580f68 None None] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-88bafa80-7b83-4ad8-895e-22e585580f68 None None] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:13 user devstack@n-api.service[61511]: INFO nova.compute.rpcapi [None req-88bafa80-7b83-4ad8-895e-22e585580f68 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 21 15:32:13 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-88bafa80-7b83-4ad8-895e-22e585580f68 None None] Releasing lock "compute-rpcapi-router" {{(pid=61511) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 21 15:32:13 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-88bafa80-7b83-4ad8-895e-22e585580f68 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233467 Apr 21 15:32:13 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 26/70] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:15 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-41213263-da08-46ab-b87b-3c776c9e9aeb req-c4930dad-a5ae-459a-bc80-1b23510d38b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662c333c-a6b4-4fec-90e5-3712fbebfc4d", "tag": "715a5a9e-5f15-4938-a3c5-c206f4b16794"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:15 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-41213263-da08-46ab-b87b-3c776c9e9aeb req-c4930dad-a5ae-459a-bc80-1b23510d38b0 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:15 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-41213263-da08-46ab-b87b-3c776c9e9aeb req-c4930dad-a5ae-459a-bc80-1b23510d38b0 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:15 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-41213263-da08-46ab-b87b-3c776c9e9aeb req-c4930dad-a5ae-459a-bc80-1b23510d38b0 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:15 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-41213263-da08-46ab-b87b-3c776c9e9aeb req-c4930dad-a5ae-459a-bc80-1b23510d38b0 service nova] Creating event network-changed:715a5a9e-5f15-4938-a3c5-c206f4b16794 for instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d on user Apr 21 15:32:15 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-41213263-da08-46ab-b87b-3c776c9e9aeb req-c4930dad-a5ae-459a-bc80-1b23510d38b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030504 Apr 21 15:32:15 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 22/71] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=10 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Getting quotas for project 0a0f7bbaef144dd48802a9fec82525fc. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Getting quotas for user e2bcea96817e44e0b433b42e617329a1 and project 0a0f7bbaef144dd48802a9fec82525fc. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:32:15 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: d9cce6ca-aeb4-454a-83db-794936352483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:32:15 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c07e0c4b-3a39-4648-977c-05a917c8955e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.685402 Apr 21 15:32:15 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 24/72] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 15:32:12 2023] POST /compute/v2.1/servers => generated 378 bytes in 2687 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 15:32:15 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-e04e2802-48bf-40c2-af30-8aea09768e9c tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:32:15 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-e04e2802-48bf-40c2-af30-8aea09768e9c tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: d9cce6ca-aeb4-454a-83db-794936352483] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:32:15 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-e04e2802-48bf-40c2-af30-8aea09768e9c tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:15 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-e04e2802-48bf-40c2-af30-8aea09768e9c tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:15 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-e04e2802-48bf-40c2-af30-8aea09768e9c tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:15 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-e04e2802-48bf-40c2-af30-8aea09768e9c tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483" status: 200 len: 1394 microversion: 2.87 time: 0.160195 Apr 21 15:32:15 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 27/73] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:32:15 2023] GET /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483 => generated 1394 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:32:18 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=8 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:18 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-428a1931-ff94-4fc9-b476-2404ba9435be req-dd541d42-4a65-478f-98d3-3545f19e2ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9cce6ca-aeb4-454a-83db-794936352483", "tag": "07ff4ab4-9f6c-4291-89f2-281307d80a70"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:18 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-428a1931-ff94-4fc9-b476-2404ba9435be req-dd541d42-4a65-478f-98d3-3545f19e2ede service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:18 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-428a1931-ff94-4fc9-b476-2404ba9435be req-dd541d42-4a65-478f-98d3-3545f19e2ede service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:18 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-428a1931-ff94-4fc9-b476-2404ba9435be req-dd541d42-4a65-478f-98d3-3545f19e2ede service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:18 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-428a1931-ff94-4fc9-b476-2404ba9435be req-dd541d42-4a65-478f-98d3-3545f19e2ede service nova] Creating event network-changed:07ff4ab4-9f6c-4291-89f2-281307d80a70 for instance d9cce6ca-aeb4-454a-83db-794936352483 on user Apr 21 15:32:18 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-428a1931-ff94-4fc9-b476-2404ba9435be req-dd541d42-4a65-478f-98d3-3545f19e2ede service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053920 Apr 21 15:32:18 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 23/74] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:19 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-26641234", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "df728346-27f5-4b62-955a-45e68bcde88d"}], "security_groups": [{"name": "tempest-securitygroup--1538231098"}], "key_name": "tempest-keypair-520324050", "user_data": "}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:19 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] validate_networks() for [('df728346-27f5-4b62-955a-45e68bcde88d', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:32:19 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-19c56a08-7c52-496f-ad79-028a1825cb11 req-30f5c774-a336-4114-be31-187cae68a4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4f24f3-2688-4a47-938b-947b30c3694a", "name": "network-vif-plugged", "status": "completed", "tag": "a19ea3f0-2f6a-4bf6-b6af-b96310946d75"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:19 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-19c56a08-7c52-496f-ad79-028a1825cb11 req-30f5c774-a336-4114-be31-187cae68a4f3 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:19 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-19c56a08-7c52-496f-ad79-028a1825cb11 req-30f5c774-a336-4114-be31-187cae68a4f3 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:19 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-19c56a08-7c52-496f-ad79-028a1825cb11 req-30f5c774-a336-4114-be31-187cae68a4f3 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:19 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-19c56a08-7c52-496f-ad79-028a1825cb11 req-30f5c774-a336-4114-be31-187cae68a4f3 service nova] Creating event network-vif-plugged:a19ea3f0-2f6a-4bf6-b6af-b96310946d75 for instance ab4f24f3-2688-4a47-938b-947b30c3694a on user Apr 21 15:32:19 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-19c56a08-7c52-496f-ad79-028a1825cb11 req-30f5c774-a336-4114-be31-187cae68a4f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045404 Apr 21 15:32:19 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 28/75] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Getting quotas for project 9de04c4cc5f140c08c23e34065a9b59a. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Getting quotas for user 27b6dad090b84d0d9b0a8c3f6421a4b0 and project 9de04c4cc5f140c08c23e34065a9b59a. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:32:20 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 33e531c7-1e26-4ed7-8899-c97983a0fc69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:32:20 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-99e08eb5-ea48-44f5-98d2-b52befeb6375 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.743373 Apr 21 15:32:20 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 25/76] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:32:19 2023] POST /compute/v2.1/servers => generated 400 bytes in 1746 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:32:20 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-5b74cfca-7f86-4194-9370-9d1dffb52df0 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:32:20 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-5b74cfca-7f86-4194-9370-9d1dffb52df0 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 33e531c7-1e26-4ed7-8899-c97983a0fc69] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:32:21 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-5b74cfca-7f86-4194-9370-9d1dffb52df0 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b6dad090b84d0d9b0a8c3f6421a4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de04c4cc5f140c08c23e34065a9b59a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:21 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-5b74cfca-7f86-4194-9370-9d1dffb52df0 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69" status: 200 len: 1233 microversion: 2.1 time: 0.136375 Apr 21 15:32:21 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 24/77] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:32:20 2023] GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69 => generated 1233 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:32:21 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-902ce722-d77f-42c5-b52d-a2e884c2e72e req-e836fd5e-d562-4ec3-b624-9ffe81628953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4f24f3-2688-4a47-938b-947b30c3694a", "name": "network-vif-plugged", "status": "completed", "tag": "a19ea3f0-2f6a-4bf6-b6af-b96310946d75"}, {"server_uuid": "e948aeec-acfe-4862-8f6a-28e02c05c46c", "name": "network-vif-plugged", "status": "completed", "tag": "f3eeb5a5-1272-48ef-a96f-fe7cdc2fcbb6"}, {"server_uuid": "e948aeec-acfe-4862-8f6a-28e02c05c46c", "name": "network-vif-plugged", "status": "completed", "tag": "f3eeb5a5-1272-48ef-a96f-fe7cdc2fcbb6"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:21 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-902ce722-d77f-42c5-b52d-a2e884c2e72e req-e836fd5e-d562-4ec3-b624-9ffe81628953 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:21 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-902ce722-d77f-42c5-b52d-a2e884c2e72e req-e836fd5e-d562-4ec3-b624-9ffe81628953 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:21 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-902ce722-d77f-42c5-b52d-a2e884c2e72e req-e836fd5e-d562-4ec3-b624-9ffe81628953 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:21 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-902ce722-d77f-42c5-b52d-a2e884c2e72e req-e836fd5e-d562-4ec3-b624-9ffe81628953 service nova] Creating event network-vif-plugged:a19ea3f0-2f6a-4bf6-b6af-b96310946d75 for instance ab4f24f3-2688-4a47-938b-947b30c3694a on user Apr 21 15:32:21 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-902ce722-d77f-42c5-b52d-a2e884c2e72e req-e836fd5e-d562-4ec3-b624-9ffe81628953 service nova] Creating event network-vif-plugged:f3eeb5a5-1272-48ef-a96f-fe7cdc2fcbb6 for instance e948aeec-acfe-4862-8f6a-28e02c05c46c on user Apr 21 15:32:21 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-902ce722-d77f-42c5-b52d-a2e884c2e72e req-e836fd5e-d562-4ec3-b624-9ffe81628953 service nova] Creating event network-vif-plugged:f3eeb5a5-1272-48ef-a96f-fe7cdc2fcbb6 for instance e948aeec-acfe-4862-8f6a-28e02c05c46c on user Apr 21 15:32:21 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-902ce722-d77f-42c5-b52d-a2e884c2e72e req-e836fd5e-d562-4ec3-b624-9ffe81628953 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.063851 Apr 21 15:32:21 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 29/78] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:21 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:23 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-9fd26aaf-9607-412c-9cc3-0d7fa142bad4 req-9c9e8e60-c8ce-4582-85c1-d22922ce93c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cce6ca-aeb4-454a-83db-794936352483", "name": "network-vif-plugged", "status": "completed", "tag": "07ff4ab4-9f6c-4291-89f2-281307d80a70"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-9fd26aaf-9607-412c-9cc3-0d7fa142bad4 req-9c9e8e60-c8ce-4582-85c1-d22922ce93c2 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-9fd26aaf-9607-412c-9cc3-0d7fa142bad4 req-9c9e8e60-c8ce-4582-85c1-d22922ce93c2 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-9fd26aaf-9607-412c-9cc3-0d7fa142bad4 req-9c9e8e60-c8ce-4582-85c1-d22922ce93c2 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:23 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-9fd26aaf-9607-412c-9cc3-0d7fa142bad4 req-9c9e8e60-c8ce-4582-85c1-d22922ce93c2 service nova] Creating event network-vif-plugged:07ff4ab4-9f6c-4291-89f2-281307d80a70 for instance d9cce6ca-aeb4-454a-83db-794936352483 on user Apr 21 15:32:23 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-9fd26aaf-9607-412c-9cc3-0d7fa142bad4 req-9c9e8e60-c8ce-4582-85c1-d22922ce93c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065192 Apr 21 15:32:23 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 26/79] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:23 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-6f806f22-16f1-4497-acdb-d8cea0e5f642 req-cf867a6c-8f7c-4983-9088-a308020bdb55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662c333c-a6b4-4fec-90e5-3712fbebfc4d", "name": "network-vif-plugged", "status": "completed", "tag": "715a5a9e-5f15-4938-a3c5-c206f4b16794"}, {"server_uuid": "662c333c-a6b4-4fec-90e5-3712fbebfc4d", "name": "network-vif-plugged", "status": "completed", "tag": "715a5a9e-5f15-4938-a3c5-c206f4b16794"}, {"server_uuid": "2da62263-7d42-447d-abee-597a75abb16f", "name": "network-vif-plugged", "status": "completed", "tag": "37a7d258-7421-45a2-a4ba-5efa8c64120d"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:23 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-6f806f22-16f1-4497-acdb-d8cea0e5f642 req-cf867a6c-8f7c-4983-9088-a308020bdb55 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-6f806f22-16f1-4497-acdb-d8cea0e5f642 req-cf867a6c-8f7c-4983-9088-a308020bdb55 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-6f806f22-16f1-4497-acdb-d8cea0e5f642 req-cf867a6c-8f7c-4983-9088-a308020bdb55 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:23 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-6f806f22-16f1-4497-acdb-d8cea0e5f642 req-cf867a6c-8f7c-4983-9088-a308020bdb55 service nova] Creating event network-vif-plugged:715a5a9e-5f15-4938-a3c5-c206f4b16794 for instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d on user Apr 21 15:32:23 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-6f806f22-16f1-4497-acdb-d8cea0e5f642 req-cf867a6c-8f7c-4983-9088-a308020bdb55 service nova] Creating event network-vif-plugged:715a5a9e-5f15-4938-a3c5-c206f4b16794 for instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d on user Apr 21 15:32:23 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-6f806f22-16f1-4497-acdb-d8cea0e5f642 req-cf867a6c-8f7c-4983-9088-a308020bdb55 service nova] Creating event network-vif-plugged:37a7d258-7421-45a2-a4ba-5efa8c64120d for instance 2da62263-7d42-447d-abee-597a75abb16f on user Apr 21 15:32:23 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-6f806f22-16f1-4497-acdb-d8cea0e5f642 req-cf867a6c-8f7c-4983-9088-a308020bdb55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.074390 Apr 21 15:32:23 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 25/80] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:23 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:25 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:25 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-05c7735b-dee5-4008-b3a8-c5e596605c6a req-3a1ec456-c0a5-45f8-8637-1289a9f3ff44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cce6ca-aeb4-454a-83db-794936352483", "name": "network-vif-plugged", "status": "completed", "tag": "07ff4ab4-9f6c-4291-89f2-281307d80a70"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:25 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-05c7735b-dee5-4008-b3a8-c5e596605c6a req-3a1ec456-c0a5-45f8-8637-1289a9f3ff44 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:25 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-05c7735b-dee5-4008-b3a8-c5e596605c6a req-3a1ec456-c0a5-45f8-8637-1289a9f3ff44 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:25 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-05c7735b-dee5-4008-b3a8-c5e596605c6a req-3a1ec456-c0a5-45f8-8637-1289a9f3ff44 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:25 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-05c7735b-dee5-4008-b3a8-c5e596605c6a req-3a1ec456-c0a5-45f8-8637-1289a9f3ff44 service nova] Creating event network-vif-plugged:07ff4ab4-9f6c-4291-89f2-281307d80a70 for instance d9cce6ca-aeb4-454a-83db-794936352483 on user Apr 21 15:32:25 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-05c7735b-dee5-4008-b3a8-c5e596605c6a req-3a1ec456-c0a5-45f8-8637-1289a9f3ff44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101020 Apr 21 15:32:25 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 30/81] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:26 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-879e4ff5-cf6b-42b2-a8c7-75fb32384c45 req-fb31ee69-9dc8-4cd5-982c-3588f444c871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da62263-7d42-447d-abee-597a75abb16f", "name": "network-vif-plugged", "status": "completed", "tag": "37a7d258-7421-45a2-a4ba-5efa8c64120d"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-879e4ff5-cf6b-42b2-a8c7-75fb32384c45 req-fb31ee69-9dc8-4cd5-982c-3588f444c871 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-879e4ff5-cf6b-42b2-a8c7-75fb32384c45 req-fb31ee69-9dc8-4cd5-982c-3588f444c871 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-879e4ff5-cf6b-42b2-a8c7-75fb32384c45 req-fb31ee69-9dc8-4cd5-982c-3588f444c871 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:26 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-879e4ff5-cf6b-42b2-a8c7-75fb32384c45 req-fb31ee69-9dc8-4cd5-982c-3588f444c871 service nova] Creating event network-vif-plugged:37a7d258-7421-45a2-a4ba-5efa8c64120d for instance 2da62263-7d42-447d-abee-597a75abb16f on user Apr 21 15:32:26 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-879e4ff5-cf6b-42b2-a8c7-75fb32384c45 req-fb31ee69-9dc8-4cd5-982c-3588f444c871 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044070 Apr 21 15:32:26 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:31 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:31 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-ed7c8da0-dedc-49f0-b2e8-feef41e5a1a4 req-384299c0-4305-44db-b5e0-bdd4a389a822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e531c7-1e26-4ed7-8899-c97983a0fc69", "tag": "48c5fc84-8631-499b-a1c2-aade3a7569d2"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:31 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-ed7c8da0-dedc-49f0-b2e8-feef41e5a1a4 req-384299c0-4305-44db-b5e0-bdd4a389a822 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:31 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-ed7c8da0-dedc-49f0-b2e8-feef41e5a1a4 req-384299c0-4305-44db-b5e0-bdd4a389a822 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:31 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-ed7c8da0-dedc-49f0-b2e8-feef41e5a1a4 req-384299c0-4305-44db-b5e0-bdd4a389a822 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:31 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-ed7c8da0-dedc-49f0-b2e8-feef41e5a1a4 req-384299c0-4305-44db-b5e0-bdd4a389a822 service nova] Creating event network-changed:48c5fc84-8631-499b-a1c2-aade3a7569d2 for instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 on user Apr 21 15:32:31 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-ed7c8da0-dedc-49f0-b2e8-feef41e5a1a4 req-384299c0-4305-44db-b5e0-bdd4a389a822 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036633 Apr 21 15:32:31 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 26/83] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:34 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=20 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:34 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-60b0d2dc-3ed3-4113-a391-a93a081b1743 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Action: 'create', calling method: .version_select at 0x7f0c149ae4d0>, body: {"keypair": {"name": "tempest-keypair-1631879295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ9U4BxJh92EpT79ub2CVCgigvEwzrfqdAHZ9ZjY75lAMyv8HxQv4CPBTf7pTWto5hHyirqIBURSRdZ8GoC5RThKHlUrSp3tubWX530UyXRONHt5+fBYK/UyRN4HtNgw=="}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:34 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:34 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-60b0d2dc-3ed3-4113-a391-a93a081b1743 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Getting quotas for project 94fbad07c9b34d6693e5e0bd8394fd31. Resources: {'key_pairs'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:32:34 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-60b0d2dc-3ed3-4113-a391-a93a081b1743 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Getting quotas for user 2b7d38149c5e459a92d456ed03ab4beb and project 94fbad07c9b34d6693e5e0bd8394fd31. Resources: {'key_pairs'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:32:34 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-60b0d2dc-3ed3-4113-a391-a93a081b1743 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.372233 Apr 21 15:32:34 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 31/84] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:32:34 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:35 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=8 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:35 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=12 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:35 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-96030b56-fa70-434f-9df3-e4a5344bb0c8 req-73d53023-4bad-44da-9305-d44a4793213e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e531c7-1e26-4ed7-8899-c97983a0fc69", "name": "network-vif-plugged", "status": "completed", "tag": "48c5fc84-8631-499b-a1c2-aade3a7569d2"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:35 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=9 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-96030b56-fa70-434f-9df3-e4a5344bb0c8 req-73d53023-4bad-44da-9305-d44a4793213e service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-96030b56-fa70-434f-9df3-e4a5344bb0c8 req-73d53023-4bad-44da-9305-d44a4793213e service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-96030b56-fa70-434f-9df3-e4a5344bb0c8 req-73d53023-4bad-44da-9305-d44a4793213e service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:35 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=15 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-96030b56-fa70-434f-9df3-e4a5344bb0c8 req-73d53023-4bad-44da-9305-d44a4793213e service nova] Creating event network-vif-plugged:48c5fc84-8631-499b-a1c2-aade3a7569d2 for instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 on user Apr 21 15:32:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-96030b56-fa70-434f-9df3-e4a5344bb0c8 req-73d53023-4bad-44da-9305-d44a4793213e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064832 Apr 21 15:32:35 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 28/85] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:37 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-7b988765-26b3-4bc6-a8cd-a6cb63bc1b64 req-990d93ed-0657-458f-bff4-64936b62d635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e531c7-1e26-4ed7-8899-c97983a0fc69", "name": "network-vif-plugged", "status": "completed", "tag": "48c5fc84-8631-499b-a1c2-aade3a7569d2"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:37 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-7b988765-26b3-4bc6-a8cd-a6cb63bc1b64 req-990d93ed-0657-458f-bff4-64936b62d635 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-7b988765-26b3-4bc6-a8cd-a6cb63bc1b64 req-990d93ed-0657-458f-bff4-64936b62d635 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-7b988765-26b3-4bc6-a8cd-a6cb63bc1b64 req-990d93ed-0657-458f-bff4-64936b62d635 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:37 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=15 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:37 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-7b988765-26b3-4bc6-a8cd-a6cb63bc1b64 req-990d93ed-0657-458f-bff4-64936b62d635 service nova] Creating event network-vif-plugged:48c5fc84-8631-499b-a1c2-aade3a7569d2 for instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 on user Apr 21 15:32:37 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-7b988765-26b3-4bc6-a8cd-a6cb63bc1b64 req-990d93ed-0657-458f-bff4-64936b62d635 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035086 Apr 21 15:32:37 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 27/86] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:37 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=14 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:37 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-474707015", "imageRef": "8975c21b-92a1-4161-8b85-4066e8cb98f0", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "3383c976-3997-44c2-9b51-57526a0571b1"}], "security_groups": [{"name": "tempest-securitygroup--11182669"}], "key_name": "tempest-keypair-1631879295", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:37 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] validate_networks() for [('3383c976-3997-44c2-9b51-57526a0571b1', None, None, None, None, None)] {{(pid=61511) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Flavor limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Image limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Flavor pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Image pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Getting quotas for project 94fbad07c9b34d6693e5e0bd8394fd31. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Getting quotas for user 2b7d38149c5e459a92d456ed03ab4beb and project 94fbad07c9b34d6693e5e0bd8394fd31. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Going to run 1 instances... {{(pid=61511) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:32:38 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] [instance: 415751ed-a1e9-4249-9fcb-e9d609818b17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8975c21b-92a1-4161-8b85-4066e8cb98f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:32:38 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-cc0acfe8-a9e3-4b22-87ff-bda168279303 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.104489 Apr 21 15:32:38 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 32/87] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:32:37 2023] POST /compute/v2.1/servers => generated 402 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:32:38 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-aec814fc-fee4-4153-971e-f3ec60040fc5 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:32:38 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-aec814fc-fee4-4153-971e-f3ec60040fc5 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] [instance: 415751ed-a1e9-4249-9fcb-e9d609818b17] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:32:39 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-aec814fc-fee4-4153-971e-f3ec60040fc5 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7d38149c5e459a92d456ed03ab4beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fbad07c9b34d6693e5e0bd8394fd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-aec814fc-fee4-4153-971e-f3ec60040fc5 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17" status: 200 len: 1239 microversion: 2.1 time: 0.154257 Apr 21 15:32:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 29/88] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:32:38 2023] GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17 => generated 1239 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:32:42 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-3ef04144-1863-4037-ad95-45272dbef01b req-21f52197-015e-482d-aceb-4d2311154f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415751ed-a1e9-4249-9fcb-e9d609818b17", "tag": "f9d8e336-0aae-4822-aa8f-896130992c81"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-3ef04144-1863-4037-ad95-45272dbef01b req-21f52197-015e-482d-aceb-4d2311154f04 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-3ef04144-1863-4037-ad95-45272dbef01b req-21f52197-015e-482d-aceb-4d2311154f04 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-3ef04144-1863-4037-ad95-45272dbef01b req-21f52197-015e-482d-aceb-4d2311154f04 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:42 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-3ef04144-1863-4037-ad95-45272dbef01b req-21f52197-015e-482d-aceb-4d2311154f04 service nova] Creating event network-changed:f9d8e336-0aae-4822-aa8f-896130992c81 for instance 415751ed-a1e9-4249-9fcb-e9d609818b17 on user Apr 21 15:32:42 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-3ef04144-1863-4037-ad95-45272dbef01b req-21f52197-015e-482d-aceb-4d2311154f04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036659 Apr 21 15:32:42 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 28/89] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 15:32:45 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-91678ec8-aa06-40b5-b3ef-aea567c46d89 req-e75cf237-3f2b-4e97-9586-d9f41bbdc140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415751ed-a1e9-4249-9fcb-e9d609818b17", "name": "network-vif-plugged", "status": "completed", "tag": "f9d8e336-0aae-4822-aa8f-896130992c81"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-91678ec8-aa06-40b5-b3ef-aea567c46d89 req-e75cf237-3f2b-4e97-9586-d9f41bbdc140 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-91678ec8-aa06-40b5-b3ef-aea567c46d89 req-e75cf237-3f2b-4e97-9586-d9f41bbdc140 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-91678ec8-aa06-40b5-b3ef-aea567c46d89 req-e75cf237-3f2b-4e97-9586-d9f41bbdc140 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:45 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-91678ec8-aa06-40b5-b3ef-aea567c46d89 req-e75cf237-3f2b-4e97-9586-d9f41bbdc140 service nova] Creating event network-vif-plugged:f9d8e336-0aae-4822-aa8f-896130992c81 for instance 415751ed-a1e9-4249-9fcb-e9d609818b17 on user Apr 21 15:32:45 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-91678ec8-aa06-40b5-b3ef-aea567c46d89 req-e75cf237-3f2b-4e97-9586-d9f41bbdc140 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060005 Apr 21 15:32:45 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 33/90] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:47 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-bae79dfa-46c4-4f86-a223-4d7a8495aa3d req-0ba79f67-e0da-4c12-b29b-ae69ed3f16fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415751ed-a1e9-4249-9fcb-e9d609818b17", "name": "network-vif-plugged", "status": "completed", "tag": "f9d8e336-0aae-4822-aa8f-896130992c81"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:47 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-bae79dfa-46c4-4f86-a223-4d7a8495aa3d req-0ba79f67-e0da-4c12-b29b-ae69ed3f16fd service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-bae79dfa-46c4-4f86-a223-4d7a8495aa3d req-0ba79f67-e0da-4c12-b29b-ae69ed3f16fd service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-bae79dfa-46c4-4f86-a223-4d7a8495aa3d req-0ba79f67-e0da-4c12-b29b-ae69ed3f16fd service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:47 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-bae79dfa-46c4-4f86-a223-4d7a8495aa3d req-0ba79f67-e0da-4c12-b29b-ae69ed3f16fd service nova] Creating event network-vif-plugged:f9d8e336-0aae-4822-aa8f-896130992c81 for instance 415751ed-a1e9-4249-9fcb-e9d609818b17 on user Apr 21 15:32:47 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-bae79dfa-46c4-4f86-a223-4d7a8495aa3d req-0ba79f67-e0da-4c12-b29b-ae69ed3f16fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044740 Apr 21 15:32:47 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 30/91] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 15:32:52 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=3 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:52 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=3 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:52 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-b497ae55-d4e4-48c7-96f7-30072d4225cc tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Action: 'create', calling method: .version_select at 0x7f0c148108b0>, body: {"keypair": {"name": "tempest-keypair-257006120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfMTRNKeeptkiiQ1bhl+bovwx+v1yPjw4mbfZO38KiJ1UzkgB4br52LmIkw+m6TGsjVvLm0C29TMWrG1+dQ0Bi+74/6IzBMQe8Z2RSFIV+IXAkaq9PXGORu7p4GERJKvA=="}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:52 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-b497ae55-d4e4-48c7-96f7-30072d4225cc tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Getting quotas for project b4825737e417473f930a05f796980264. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:32:52 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-b497ae55-d4e4-48c7-96f7-30072d4225cc tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Getting quotas for user c901c0ffdf6e42f2a9c826aecb667d89 and project b4825737e417473f930a05f796980264. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:32:52 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-b497ae55-d4e4-48c7-96f7-30072d4225cc tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.210355 Apr 21 15:32:52 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 29/92] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:32:52 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=10 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1195404415", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "networks": [{"uuid": "48499b46-b6c7-457a-9bdf-0c6591945aaf"}], "security_groups": [{"name": "tempest-securitygroup--232057127"}], "key_name": "tempest-keypair-257006120", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] validate_networks() for [('48499b46-b6c7-457a-9bdf-0c6591945aaf', None, None, None, None, None)] {{(pid=61511) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:32:54 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:32:54 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-d51024da-557a-4392-8ab6-56a4ecc6d150 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:32:54 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-d51024da-557a-4392-8ab6-56a4ecc6d150 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: e948aeec-acfe-4862-8f6a-28e02c05c46c] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:32:54 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d51024da-557a-4392-8ab6-56a4ecc6d150 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:54 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d51024da-557a-4392-8ab6-56a4ecc6d150 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:54 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d51024da-557a-4392-8ab6-56a4ecc6d150 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:54 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d51024da-557a-4392-8ab6-56a4ecc6d150 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:54 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d51024da-557a-4392-8ab6-56a4ecc6d150 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:54 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d51024da-557a-4392-8ab6-56a4ecc6d150 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Flavor limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Image limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Flavor pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Image pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Getting quotas for project b4825737e417473f930a05f796980264. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Getting quotas for user c901c0ffdf6e42f2a9c826aecb667d89 and project b4825737e417473f930a05f796980264. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Going to run 1 instances... {{(pid=61511) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:32:54 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] [instance: 728b5fa0-caca-423d-a105-7789d7c242bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:32:55 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-0e94d115-0604-461b-9434-cb9a47b4d9b7 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.688344 Apr 21 15:32:55 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 34/93] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:32:54 2023] POST /compute/v2.1/servers => generated 403 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:32:55 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-ea738e69-0c54-47dd-910b-c24b417a9652 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:32:55 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-ea738e69-0c54-47dd-910b-c24b417a9652 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] [instance: 728b5fa0-caca-423d-a105-7789d7c242bd] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:32:55 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-ea738e69-0c54-47dd-910b-c24b417a9652 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c901c0ffdf6e42f2a9c826aecb667d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4825737e417473f930a05f796980264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:55 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-ea738e69-0c54-47dd-910b-c24b417a9652 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd" status: 200 len: 1239 microversion: 2.1 time: 0.106503 Apr 21 15:32:55 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 30/94] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:32:55 2023] GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd => generated 1239 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:32:55 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-bb972b83-d755-4ce7-ae04-7feaf4be80d0 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:32:55 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-bb972b83-d755-4ce7-ae04-7feaf4be80d0 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] [instance: ab4f24f3-2688-4a47-938b-947b30c3694a] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:32:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-bb972b83-d755-4ce7-ae04-7feaf4be80d0 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-bb972b83-d755-4ce7-ae04-7feaf4be80d0 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-bb972b83-d755-4ce7-ae04-7feaf4be80d0 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-bb972b83-d755-4ce7-ae04-7feaf4be80d0 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-bb972b83-d755-4ce7-ae04-7feaf4be80d0 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-bb972b83-d755-4ce7-ae04-7feaf4be80d0 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:55 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-d51024da-557a-4392-8ab6-56a4ecc6d150 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c07c4b2ee5404db0ad5e5126dcdfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a34de8879c43bcb72b8eb70df45700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:55 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-d51024da-557a-4392-8ab6-56a4ecc6d150 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c" status: 200 len: 1493 microversion: 2.1 time: 0.641210 Apr 21 15:32:55 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 31/95] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:32:54 2023] GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c => generated 1493 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:32:55 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-bb972b83-d755-4ce7-ae04-7feaf4be80d0 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06bf99010b5f45f2bfb834e3d6bb7f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80135d0f2158413da39596602a3cdc02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:55 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-bb972b83-d755-4ce7-ae04-7feaf4be80d0 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab4f24f3-2688-4a47-938b-947b30c3694a" status: 200 len: 1490 microversion: 2.1 time: 0.358330 Apr 21 15:32:55 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 35/96] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:32:55 2023] GET /compute/v2.1/servers/ab4f24f3-2688-4a47-938b-947b30c3694a => generated 1490 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:32:55 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-abd299f4-03d9-4c90-8788-f75c6d3b2782 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:32:55 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-abd299f4-03d9-4c90-8788-f75c6d3b2782 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 662c333c-a6b4-4fec-90e5-3712fbebfc4d] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:32:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-abd299f4-03d9-4c90-8788-f75c6d3b2782 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-abd299f4-03d9-4c90-8788-f75c6d3b2782 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-abd299f4-03d9-4c90-8788-f75c6d3b2782 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-abd299f4-03d9-4c90-8788-f75c6d3b2782 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-abd299f4-03d9-4c90-8788-f75c6d3b2782 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-abd299f4-03d9-4c90-8788-f75c6d3b2782 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:56 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-abd299f4-03d9-4c90-8788-f75c6d3b2782 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e5168c1014774b77090a1eeb56abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9caeb7a6f3674392afae6edf987420fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:32:56 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-abd299f4-03d9-4c90-8788-f75c6d3b2782 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d" status: 200 len: 1503 microversion: 2.1 time: 0.338825 Apr 21 15:32:56 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 31/97] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:32:55 2023] GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d => generated 1503 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:32:58 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-05fadac9-34bd-4f3e-aa8a-b7be298298cd req-e7a354e7-975e-48a0-a846-aa00a48d01e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "728b5fa0-caca-423d-a105-7789d7c242bd", "tag": "b15324cd-b962-4849-85dc-175318b9011a"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:32:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-05fadac9-34bd-4f3e-aa8a-b7be298298cd req-e7a354e7-975e-48a0-a846-aa00a48d01e1 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:32:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-05fadac9-34bd-4f3e-aa8a-b7be298298cd req-e7a354e7-975e-48a0-a846-aa00a48d01e1 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:32:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-05fadac9-34bd-4f3e-aa8a-b7be298298cd req-e7a354e7-975e-48a0-a846-aa00a48d01e1 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:32:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-05fadac9-34bd-4f3e-aa8a-b7be298298cd req-e7a354e7-975e-48a0-a846-aa00a48d01e1 service nova] Creating event network-changed:b15324cd-b962-4849-85dc-175318b9011a for instance 728b5fa0-caca-423d-a105-7789d7c242bd on user Apr 21 15:32:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-05fadac9-34bd-4f3e-aa8a-b7be298298cd req-e7a354e7-975e-48a0-a846-aa00a48d01e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038304 Apr 21 15:32:58 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 32/98] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:32:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:33:00 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-8b315363-8a3d-48e8-ba09-1f325cf43788 req-06a0ec3d-3636-404e-9d44-a7b8161abe87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728b5fa0-caca-423d-a105-7789d7c242bd", "name": "network-vif-plugged", "status": "completed", "tag": "b15324cd-b962-4849-85dc-175318b9011a"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:33:00 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-8b315363-8a3d-48e8-ba09-1f325cf43788 req-06a0ec3d-3636-404e-9d44-a7b8161abe87 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:00 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-8b315363-8a3d-48e8-ba09-1f325cf43788 req-06a0ec3d-3636-404e-9d44-a7b8161abe87 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:00 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-8b315363-8a3d-48e8-ba09-1f325cf43788 req-06a0ec3d-3636-404e-9d44-a7b8161abe87 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:00 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-8b315363-8a3d-48e8-ba09-1f325cf43788 req-06a0ec3d-3636-404e-9d44-a7b8161abe87 service nova] Creating event network-vif-plugged:b15324cd-b962-4849-85dc-175318b9011a for instance 728b5fa0-caca-423d-a105-7789d7c242bd on user Apr 21 15:33:00 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-8b315363-8a3d-48e8-ba09-1f325cf43788 req-06a0ec3d-3636-404e-9d44-a7b8161abe87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038623 Apr 21 15:33:00 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 36/99] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:33:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:33:02 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-0e864cfa-ee17-471d-bb2d-8590bb965198 req-2f490740-b063-4589-92bb-09ac0ff1beee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728b5fa0-caca-423d-a105-7789d7c242bd", "name": "network-vif-plugged", "status": "completed", "tag": "b15324cd-b962-4849-85dc-175318b9011a"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:33:02 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-0e864cfa-ee17-471d-bb2d-8590bb965198 req-2f490740-b063-4589-92bb-09ac0ff1beee service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:02 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-0e864cfa-ee17-471d-bb2d-8590bb965198 req-2f490740-b063-4589-92bb-09ac0ff1beee service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:02 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-0e864cfa-ee17-471d-bb2d-8590bb965198 req-2f490740-b063-4589-92bb-09ac0ff1beee service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:02 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-0e864cfa-ee17-471d-bb2d-8590bb965198 req-2f490740-b063-4589-92bb-09ac0ff1beee service nova] Creating event network-vif-plugged:b15324cd-b962-4849-85dc-175318b9011a for instance 728b5fa0-caca-423d-a105-7789d7c242bd on user Apr 21 15:33:02 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-0e864cfa-ee17-471d-bb2d-8590bb965198 req-2f490740-b063-4589-92bb-09ac0ff1beee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055696 Apr 21 15:33:02 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 32/100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:33:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:33:05 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-98d4ef64-44f9-4af1-b3f4-09f24100d397 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:33:05 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-98d4ef64-44f9-4af1-b3f4-09f24100d397 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: d9cce6ca-aeb4-454a-83db-794936352483] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:33:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-98d4ef64-44f9-4af1-b3f4-09f24100d397 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-98d4ef64-44f9-4af1-b3f4-09f24100d397 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-98d4ef64-44f9-4af1-b3f4-09f24100d397 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-98d4ef64-44f9-4af1-b3f4-09f24100d397 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-98d4ef64-44f9-4af1-b3f4-09f24100d397 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-98d4ef64-44f9-4af1-b3f4-09f24100d397 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:06 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-98d4ef64-44f9-4af1-b3f4-09f24100d397 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:33:06 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-98d4ef64-44f9-4af1-b3f4-09f24100d397 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:33:06 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-98d4ef64-44f9-4af1-b3f4-09f24100d397 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:33:06 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-98d4ef64-44f9-4af1-b3f4-09f24100d397 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483" status: 200 len: 1691 microversion: 2.87 time: 0.334462 Apr 21 15:33:06 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 33/101] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:33:05 2023] GET /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483 => generated 1691 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=7 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=14 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-2d9d4000-216c-4351-9a4c-90b15a69d892 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-2d9d4000-216c-4351-9a4c-90b15a69d892 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 33e531c7-1e26-4ed7-8899-c97983a0fc69] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2d9d4000-216c-4351-9a4c-90b15a69d892 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2d9d4000-216c-4351-9a4c-90b15a69d892 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2d9d4000-216c-4351-9a4c-90b15a69d892 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2d9d4000-216c-4351-9a4c-90b15a69d892 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2d9d4000-216c-4351-9a4c-90b15a69d892 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2d9d4000-216c-4351-9a4c-90b15a69d892 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:11 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-2d9d4000-216c-4351-9a4c-90b15a69d892 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b6dad090b84d0d9b0a8c3f6421a4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de04c4cc5f140c08c23e34065a9b59a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:33:11 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-2d9d4000-216c-4351-9a4c-90b15a69d892 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69" status: 200 len: 1543 microversion: 2.1 time: 0.273634 Apr 21 15:33:11 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 37/102] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:33:11 2023] GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69 => generated 1543 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:33:17 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=6 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:17 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:17 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=8 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:18 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-a40ad851-51bc-4d4c-8ec4-02502a8213a9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Action: 'create', calling method: .version_select at 0x7f0c148136d0>, body: {"keypair": {"name": "tempest-keypair-2113745404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFn6pUzwSDgFaQ2fEGvzd6PnlfSCdf12PIm61Op0NBZ5T651Be9SWTVqXP6VDr9U7sjP4S9l6gVJ6oSvp08XCXCC3ciPuTiMdNJPMsVQnbWxW2IJkEz+0V44Y/NSaVtqw=="}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:33:18 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-a40ad851-51bc-4d4c-8ec4-02502a8213a9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Getting quotas for project 646a4c1a69b34d6d99324c082d74efcb. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:33:18 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-a40ad851-51bc-4d4c-8ec4-02502a8213a9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Getting quotas for user a0bf3ef5fa614461b212054b7b9cd479 and project 646a4c1a69b34d6d99324c082d74efcb. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:33:18 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-a40ad851-51bc-4d4c-8ec4-02502a8213a9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.221698 Apr 21 15:33:18 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 33/103] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:33:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-629309053", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "fef12e5a-d4c5-4593-854b-2c9017a014cf"}], "security_groups": [{"name": "tempest-securitygroup--1496980131"}], "key_name": "tempest-keypair-2113745404", "user_data": "}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=16 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=15 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] validate_networks() for [('fef12e5a-d4c5-4593-854b-2c9017a014cf', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:20 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Getting quotas for project 646a4c1a69b34d6d99324c082d74efcb. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:33:20 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Getting quotas for user a0bf3ef5fa614461b212054b7b9cd479 and project 646a4c1a69b34d6d99324c082d74efcb. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:33:20 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:33:20 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:33:20 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c4761ab1-6ddd-46c9-9b28-86924ce511c9 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.602173 Apr 21 15:33:20 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 34/104] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:33:19 2023] POST /compute/v2.1/servers => generated 407 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:33:20 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-1952046e-b3d1-476c-b32e-07c06eb8fa3b tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:33:20 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-1952046e-b3d1-476c-b32e-07c06eb8fa3b tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:33:20 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-1952046e-b3d1-476c-b32e-07c06eb8fa3b tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:33:20 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-1952046e-b3d1-476c-b32e-07c06eb8fa3b tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1232 microversion: 2.1 time: 0.063654 Apr 21 15:33:20 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 38/105] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:33:20 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1232 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:33:22 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-d03e8195-e697-467d-9239-52a0b30269ce req-d5ada945-c2ed-45b0-b3ad-f83e281b6f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6e1f23-e822-4a09-81f3-7e20ba206859", "tag": "323ad3b5-ae92-4ce7-856c-e9d50ba56c97"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:33:22 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-d03e8195-e697-467d-9239-52a0b30269ce req-d5ada945-c2ed-45b0-b3ad-f83e281b6f34 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:22 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-d03e8195-e697-467d-9239-52a0b30269ce req-d5ada945-c2ed-45b0-b3ad-f83e281b6f34 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:22 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-d03e8195-e697-467d-9239-52a0b30269ce req-d5ada945-c2ed-45b0-b3ad-f83e281b6f34 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:22 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-d03e8195-e697-467d-9239-52a0b30269ce req-d5ada945-c2ed-45b0-b3ad-f83e281b6f34 service nova] Creating event network-changed:323ad3b5-ae92-4ce7-856c-e9d50ba56c97 for instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 on user Apr 21 15:33:22 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-d03e8195-e697-467d-9239-52a0b30269ce req-d5ada945-c2ed-45b0-b3ad-f83e281b6f34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029794 Apr 21 15:33:22 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 34/106] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:33:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:33:24 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-e1ab40b8-851e-4609-bd4a-a309a64921c1 req-12144985-6e4f-4b0a-9868-7bc4d2f1cfe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6e1f23-e822-4a09-81f3-7e20ba206859", "name": "network-vif-plugged", "status": "completed", "tag": "323ad3b5-ae92-4ce7-856c-e9d50ba56c97"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:33:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e1ab40b8-851e-4609-bd4a-a309a64921c1 req-12144985-6e4f-4b0a-9868-7bc4d2f1cfe0 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e1ab40b8-851e-4609-bd4a-a309a64921c1 req-12144985-6e4f-4b0a-9868-7bc4d2f1cfe0 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:24 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e1ab40b8-851e-4609-bd4a-a309a64921c1 req-12144985-6e4f-4b0a-9868-7bc4d2f1cfe0 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:24 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-e1ab40b8-851e-4609-bd4a-a309a64921c1 req-12144985-6e4f-4b0a-9868-7bc4d2f1cfe0 service nova] Creating event network-vif-plugged:323ad3b5-ae92-4ce7-856c-e9d50ba56c97 for instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 on user Apr 21 15:33:24 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-e1ab40b8-851e-4609-bd4a-a309a64921c1 req-12144985-6e4f-4b0a-9868-7bc4d2f1cfe0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039006 Apr 21 15:33:24 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 35/107] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:33:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:33:26 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-0784d658-ff72-4e4d-b5ee-50cb943ae964 req-0fcb5745-be8b-48b7-bd6c-34c9a81eb733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6e1f23-e822-4a09-81f3-7e20ba206859", "name": "network-vif-plugged", "status": "completed", "tag": "323ad3b5-ae92-4ce7-856c-e9d50ba56c97"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:33:26 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:26 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-0784d658-ff72-4e4d-b5ee-50cb943ae964 req-0fcb5745-be8b-48b7-bd6c-34c9a81eb733 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:26 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-0784d658-ff72-4e4d-b5ee-50cb943ae964 req-0fcb5745-be8b-48b7-bd6c-34c9a81eb733 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:26 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-0784d658-ff72-4e4d-b5ee-50cb943ae964 req-0fcb5745-be8b-48b7-bd6c-34c9a81eb733 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:26 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-0784d658-ff72-4e4d-b5ee-50cb943ae964 req-0fcb5745-be8b-48b7-bd6c-34c9a81eb733 service nova] Creating event network-vif-plugged:323ad3b5-ae92-4ce7-856c-e9d50ba56c97 for instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 on user Apr 21 15:33:26 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-0784d658-ff72-4e4d-b5ee-50cb943ae964 req-0fcb5745-be8b-48b7-bd6c-34c9a81eb733 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032718 Apr 21 15:33:26 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 39/108] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:33:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:33:29 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:29 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-176c98b7-a413-4dc4-b5cd-d8814f8552f8 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:33:29 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-176c98b7-a413-4dc4-b5cd-d8814f8552f8 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] [instance: 415751ed-a1e9-4249-9fcb-e9d609818b17] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:33:29 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-176c98b7-a413-4dc4-b5cd-d8814f8552f8 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:29 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-176c98b7-a413-4dc4-b5cd-d8814f8552f8 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:29 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-176c98b7-a413-4dc4-b5cd-d8814f8552f8 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:29 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-176c98b7-a413-4dc4-b5cd-d8814f8552f8 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:29 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-176c98b7-a413-4dc4-b5cd-d8814f8552f8 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:29 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-176c98b7-a413-4dc4-b5cd-d8814f8552f8 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:29 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-176c98b7-a413-4dc4-b5cd-d8814f8552f8 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7d38149c5e459a92d456ed03ab4beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fbad07c9b34d6693e5e0bd8394fd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:33:29 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-176c98b7-a413-4dc4-b5cd-d8814f8552f8 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17" status: 200 len: 1547 microversion: 2.1 time: 0.228475 Apr 21 15:33:29 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 35/109] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:33:29 2023] GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17 => generated 1547 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-4f454e02-0950-406b-abe3-a34eb02922f6 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-4f454e02-0950-406b-abe3-a34eb02922f6 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] [instance: 728b5fa0-caca-423d-a105-7789d7c242bd] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4f454e02-0950-406b-abe3-a34eb02922f6 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4f454e02-0950-406b-abe3-a34eb02922f6 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4f454e02-0950-406b-abe3-a34eb02922f6 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4f454e02-0950-406b-abe3-a34eb02922f6 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4f454e02-0950-406b-abe3-a34eb02922f6 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4f454e02-0950-406b-abe3-a34eb02922f6 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:45 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-4f454e02-0950-406b-abe3-a34eb02922f6 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c901c0ffdf6e42f2a9c826aecb667d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4825737e417473f930a05f796980264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:33:45 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-4f454e02-0950-406b-abe3-a34eb02922f6 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd" status: 200 len: 1552 microversion: 2.1 time: 0.297597 Apr 21 15:33:45 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 36/110] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:33:45 2023] GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd => generated 1552 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:33:55 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:55 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=8 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:55 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:55 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-723787860", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "networks": [{"uuid": "a0d474c3-f7e5-4303-9474-d7483852bc0e"}]}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:33:55 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] validate_networks() for [('a0d474c3-f7e5-4303-9474-d7483852bc0e', None, None, None, None, None)] {{(pid=61511) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Flavor limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Image limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Flavor pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Image pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Getting quotas for project c6a34de8879c43bcb72b8eb70df45700. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Getting quotas for user a9c07c4b2ee5404db0ad5e5126dcdfb5 and project c6a34de8879c43bcb72b8eb70df45700. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Going to run 1 instances... {{(pid=61511) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: 77788e0b-c833-42c0-ba9b-3e32dce614f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:33:56 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-db2a9e04-3ea1-4d12-b0c5-92d8d56bca2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.554223 Apr 21 15:33:56 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 40/111] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:33:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:33:56 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-5a47f0fb-c8a9-4400-b85c-fbd390a6dca8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:33:56 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-5a47f0fb-c8a9-4400-b85c-fbd390a6dca8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: 77788e0b-c833-42c0-ba9b-3e32dce614f5] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:33:56 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:56 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=8 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:56 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b1e22a0d-1afd-45dc-93fb-d9585119037d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:33:56 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-b1e22a0d-1afd-45dc-93fb-d9585119037d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 662c333c-a6b4-4fec-90e5-3712fbebfc4d] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:33:56 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:56 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:33:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b1e22a0d-1afd-45dc-93fb-d9585119037d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b1e22a0d-1afd-45dc-93fb-d9585119037d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b1e22a0d-1afd-45dc-93fb-d9585119037d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b1e22a0d-1afd-45dc-93fb-d9585119037d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b1e22a0d-1afd-45dc-93fb-d9585119037d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b1e22a0d-1afd-45dc-93fb-d9585119037d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:56 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-5a47f0fb-c8a9-4400-b85c-fbd390a6dca8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c07c4b2ee5404db0ad5e5126dcdfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a34de8879c43bcb72b8eb70df45700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:33:56 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-5a47f0fb-c8a9-4400-b85c-fbd390a6dca8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5" status: 200 len: 1210 microversion: 2.1 time: 0.063833 Apr 21 15:33:56 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 36/112] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:33:56 2023] GET /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5 => generated 1210 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:33:56 user devstack@n-api.service[61510]: DEBUG nova.objects.instance [None req-b1e22a0d-1afd-45dc-93fb-d9585119037d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lazy-loading 'flavor' on Instance uuid 662c333c-a6b4-4fec-90e5-3712fbebfc4d {{(pid=61510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 21 15:33:56 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b1e22a0d-1afd-45dc-93fb-d9585119037d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "POST /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d/action" status: 200 len: 32 microversion: 2.1 time: 0.195595 Apr 21 15:33:56 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 37/113] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 21 15:33:56 2023] POST /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-0391b5b9-a6a2-4381-80b4-96defdb8af49 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-0391b5b9-a6a2-4381-80b4-96defdb8af49 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 662c333c-a6b4-4fec-90e5-3712fbebfc4d] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-0391b5b9-a6a2-4381-80b4-96defdb8af49 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-0391b5b9-a6a2-4381-80b4-96defdb8af49 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-0391b5b9-a6a2-4381-80b4-96defdb8af49 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-0391b5b9-a6a2-4381-80b4-96defdb8af49 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-0391b5b9-a6a2-4381-80b4-96defdb8af49 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-0391b5b9-a6a2-4381-80b4-96defdb8af49 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:56 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-0391b5b9-a6a2-4381-80b4-96defdb8af49 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e5168c1014774b77090a1eeb56abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9caeb7a6f3674392afae6edf987420fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:33:56 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-0391b5b9-a6a2-4381-80b4-96defdb8af49 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d" status: 200 len: 1509 microversion: 2.1 time: 0.476765 Apr 21 15:33:56 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 41/114] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:33:56 2023] GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d => generated 1509 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:33:57 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-a7934c87-edb5-4401-be3c-cdb342938275 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:33:57 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-a7934c87-edb5-4401-be3c-cdb342938275 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] [instance: ab4f24f3-2688-4a47-938b-947b30c3694a] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:33:57 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-a7934c87-edb5-4401-be3c-cdb342938275 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:57 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-a7934c87-edb5-4401-be3c-cdb342938275 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:57 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-a7934c87-edb5-4401-be3c-cdb342938275 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:57 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-a7934c87-edb5-4401-be3c-cdb342938275 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:57 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-a7934c87-edb5-4401-be3c-cdb342938275 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:57 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-a7934c87-edb5-4401-be3c-cdb342938275 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:57 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-a7934c87-edb5-4401-be3c-cdb342938275 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] [instance: ab4f24f3-2688-4a47-938b-947b30c3694a] Going to try to terminate instance {{(pid=61512) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:33:57 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-a7934c87-edb5-4401-be3c-cdb342938275 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ab4f24f3-2688-4a47-938b-947b30c3694a" status: 204 len: 0 microversion: 2.1 time: 0.170302 Apr 21 15:33:57 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 37/115] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:33:57 2023] DELETE /compute/v2.1/servers/ab4f24f3-2688-4a47-938b-947b30c3694a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:33:57 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-cb7195c0-252a-40c1-89cf-84de021ac425 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:33:57 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-cb7195c0-252a-40c1-89cf-84de021ac425 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] [instance: ab4f24f3-2688-4a47-938b-947b30c3694a] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:33:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-cb7195c0-252a-40c1-89cf-84de021ac425 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-cb7195c0-252a-40c1-89cf-84de021ac425 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-cb7195c0-252a-40c1-89cf-84de021ac425 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-cb7195c0-252a-40c1-89cf-84de021ac425 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-cb7195c0-252a-40c1-89cf-84de021ac425 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-cb7195c0-252a-40c1-89cf-84de021ac425 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:57 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-cb7195c0-252a-40c1-89cf-84de021ac425 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06bf99010b5f45f2bfb834e3d6bb7f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80135d0f2158413da39596602a3cdc02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:33:57 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-0261aa8f-58cf-4046-8aec-e6518f18772f req-af3be2b4-0ced-4e62-aa3f-a54b3b0799e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662c333c-a6b4-4fec-90e5-3712fbebfc4d", "name": "network-vif-unplugged", "status": "completed", "tag": "715a5a9e-5f15-4938-a3c5-c206f4b16794"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:33:57 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-cb7195c0-252a-40c1-89cf-84de021ac425 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab4f24f3-2688-4a47-938b-947b30c3694a" status: 200 len: 1496 microversion: 2.1 time: 0.283142 Apr 21 15:33:57 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 38/116] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:33:57 2023] GET /compute/v2.1/servers/ab4f24f3-2688-4a47-938b-947b30c3694a => generated 1496 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:33:57 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-0261aa8f-58cf-4046-8aec-e6518f18772f req-af3be2b4-0ced-4e62-aa3f-a54b3b0799e3 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:57 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-0261aa8f-58cf-4046-8aec-e6518f18772f req-af3be2b4-0ced-4e62-aa3f-a54b3b0799e3 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:57 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-0261aa8f-58cf-4046-8aec-e6518f18772f req-af3be2b4-0ced-4e62-aa3f-a54b3b0799e3 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:57 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-0261aa8f-58cf-4046-8aec-e6518f18772f req-af3be2b4-0ced-4e62-aa3f-a54b3b0799e3 service nova] Creating event network-vif-unplugged:715a5a9e-5f15-4938-a3c5-c206f4b16794 for instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d on user Apr 21 15:33:57 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-0261aa8f-58cf-4046-8aec-e6518f18772f req-af3be2b4-0ced-4e62-aa3f-a54b3b0799e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032221 Apr 21 15:33:57 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 42/117] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:33:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:33:59 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-5afff04d-ead5-4196-8bc7-f9c9c206e33b req-d3e68e7a-0d1a-4ee9-8a28-bd67a3c6eecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77788e0b-c833-42c0-ba9b-3e32dce614f5", "tag": "6ec169dd-b4f2-4aa2-aaa4-0f0907b8143c"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:33:59 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-5afff04d-ead5-4196-8bc7-f9c9c206e33b req-d3e68e7a-0d1a-4ee9-8a28-bd67a3c6eecf service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:59 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-5afff04d-ead5-4196-8bc7-f9c9c206e33b req-d3e68e7a-0d1a-4ee9-8a28-bd67a3c6eecf service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:59 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-5afff04d-ead5-4196-8bc7-f9c9c206e33b req-d3e68e7a-0d1a-4ee9-8a28-bd67a3c6eecf service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:59 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-5afff04d-ead5-4196-8bc7-f9c9c206e33b req-d3e68e7a-0d1a-4ee9-8a28-bd67a3c6eecf service nova] Creating event network-changed:6ec169dd-b4f2-4aa2-aaa4-0f0907b8143c for instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 on user Apr 21 15:33:59 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-5afff04d-ead5-4196-8bc7-f9c9c206e33b req-d3e68e7a-0d1a-4ee9-8a28-bd67a3c6eecf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036106 Apr 21 15:33:59 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 38/118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:33:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:33:59 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-ffefafdc-46cd-40a6-960a-0572f5d76e27 req-832e5910-3bd9-4cc8-ba88-bbdc0a3d07a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662c333c-a6b4-4fec-90e5-3712fbebfc4d", "name": "network-vif-plugged", "status": "completed", "tag": "715a5a9e-5f15-4938-a3c5-c206f4b16794"}, {"server_uuid": "ab4f24f3-2688-4a47-938b-947b30c3694a", "name": "network-vif-unplugged", "status": "completed", "tag": "a19ea3f0-2f6a-4bf6-b6af-b96310946d75"}, {"server_uuid": "ab4f24f3-2688-4a47-938b-947b30c3694a", "name": "network-vif-plugged", "status": "completed", "tag": "a19ea3f0-2f6a-4bf6-b6af-b96310946d75"}, {"server_uuid": "ab4f24f3-2688-4a47-938b-947b30c3694a", "name": "network-vif-deleted", "tag": "a19ea3f0-2f6a-4bf6-b6af-b96310946d75"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:33:59 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-ffefafdc-46cd-40a6-960a-0572f5d76e27 req-832e5910-3bd9-4cc8-ba88-bbdc0a3d07a9 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:33:59 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-ffefafdc-46cd-40a6-960a-0572f5d76e27 req-832e5910-3bd9-4cc8-ba88-bbdc0a3d07a9 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:33:59 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-ffefafdc-46cd-40a6-960a-0572f5d76e27 req-832e5910-3bd9-4cc8-ba88-bbdc0a3d07a9 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:33:59 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-ffefafdc-46cd-40a6-960a-0572f5d76e27 req-832e5910-3bd9-4cc8-ba88-bbdc0a3d07a9 service nova] Creating event network-vif-plugged:715a5a9e-5f15-4938-a3c5-c206f4b16794 for instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d on user Apr 21 15:33:59 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-ffefafdc-46cd-40a6-960a-0572f5d76e27 req-832e5910-3bd9-4cc8-ba88-bbdc0a3d07a9 service nova] Creating event network-vif-unplugged:a19ea3f0-2f6a-4bf6-b6af-b96310946d75 for instance ab4f24f3-2688-4a47-938b-947b30c3694a on user Apr 21 15:33:59 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-ffefafdc-46cd-40a6-960a-0572f5d76e27 req-832e5910-3bd9-4cc8-ba88-bbdc0a3d07a9 service nova] Creating event network-vif-plugged:a19ea3f0-2f6a-4bf6-b6af-b96310946d75 for instance ab4f24f3-2688-4a47-938b-947b30c3694a on user Apr 21 15:33:59 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-ffefafdc-46cd-40a6-960a-0572f5d76e27 req-832e5910-3bd9-4cc8-ba88-bbdc0a3d07a9 service nova] Creating event network-vif-deleted:a19ea3f0-2f6a-4bf6-b6af-b96310946d75 for instance ab4f24f3-2688-4a47-938b-947b30c3694a on user Apr 21 15:33:59 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-ffefafdc-46cd-40a6-960a-0572f5d76e27 req-832e5910-3bd9-4cc8-ba88-bbdc0a3d07a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.032550 Apr 21 15:33:59 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 39/119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:33:59 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:01 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-d1aedf33-be1f-4da2-8d3c-30e3f733c3b4 req-2f881774-4d49-4a49-b683-894688b8f832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77788e0b-c833-42c0-ba9b-3e32dce614f5", "name": "network-vif-plugged", "status": "completed", "tag": "6ec169dd-b4f2-4aa2-aaa4-0f0907b8143c"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-d1aedf33-be1f-4da2-8d3c-30e3f733c3b4 req-2f881774-4d49-4a49-b683-894688b8f832 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-d1aedf33-be1f-4da2-8d3c-30e3f733c3b4 req-2f881774-4d49-4a49-b683-894688b8f832 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-d1aedf33-be1f-4da2-8d3c-30e3f733c3b4 req-2f881774-4d49-4a49-b683-894688b8f832 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:01 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-d1aedf33-be1f-4da2-8d3c-30e3f733c3b4 req-2f881774-4d49-4a49-b683-894688b8f832 service nova] Creating event network-vif-plugged:6ec169dd-b4f2-4aa2-aaa4-0f0907b8143c for instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 on user Apr 21 15:34:01 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-d1aedf33-be1f-4da2-8d3c-30e3f733c3b4 req-2f881774-4d49-4a49-b683-894688b8f832 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029405 Apr 21 15:34:01 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 43/120] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:01 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-14c8343e-7744-458f-859d-823c556d319c req-51182a33-affd-444f-aeea-75061bf5ea58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662c333c-a6b4-4fec-90e5-3712fbebfc4d", "name": "network-vif-plugged", "status": "completed", "tag": "715a5a9e-5f15-4938-a3c5-c206f4b16794"}, {"server_uuid": "662c333c-a6b4-4fec-90e5-3712fbebfc4d", "name": "network-vif-plugged", "status": "completed", "tag": "715a5a9e-5f15-4938-a3c5-c206f4b16794"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:01 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-14c8343e-7744-458f-859d-823c556d319c req-51182a33-affd-444f-aeea-75061bf5ea58 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:01 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-14c8343e-7744-458f-859d-823c556d319c req-51182a33-affd-444f-aeea-75061bf5ea58 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:01 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-14c8343e-7744-458f-859d-823c556d319c req-51182a33-affd-444f-aeea-75061bf5ea58 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:01 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-14c8343e-7744-458f-859d-823c556d319c req-51182a33-affd-444f-aeea-75061bf5ea58 service nova] Creating event network-vif-plugged:715a5a9e-5f15-4938-a3c5-c206f4b16794 for instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d on user Apr 21 15:34:01 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-14c8343e-7744-458f-859d-823c556d319c req-51182a33-affd-444f-aeea-75061bf5ea58 service nova] Creating event network-vif-plugged:715a5a9e-5f15-4938-a3c5-c206f4b16794 for instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d on user Apr 21 15:34:01 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-14c8343e-7744-458f-859d-823c556d319c req-51182a33-affd-444f-aeea-75061bf5ea58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030179 Apr 21 15:34:01 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 39/121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-bf3f87c2-22b2-439f-a0bc-7699d90c0a19 req-24c8ebbd-d507-43eb-bcca-5048a42f72fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77788e0b-c833-42c0-ba9b-3e32dce614f5", "name": "network-vif-plugged", "status": "completed", "tag": "6ec169dd-b4f2-4aa2-aaa4-0f0907b8143c"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-bf3f87c2-22b2-439f-a0bc-7699d90c0a19 req-24c8ebbd-d507-43eb-bcca-5048a42f72fa service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-bf3f87c2-22b2-439f-a0bc-7699d90c0a19 req-24c8ebbd-d507-43eb-bcca-5048a42f72fa service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-bf3f87c2-22b2-439f-a0bc-7699d90c0a19 req-24c8ebbd-d507-43eb-bcca-5048a42f72fa service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-bf3f87c2-22b2-439f-a0bc-7699d90c0a19 req-24c8ebbd-d507-43eb-bcca-5048a42f72fa service nova] Creating event network-vif-plugged:6ec169dd-b4f2-4aa2-aaa4-0f0907b8143c for instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 on user Apr 21 15:34:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-bf3f87c2-22b2-439f-a0bc-7699d90c0a19 req-24c8ebbd-d507-43eb-bcca-5048a42f72fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029688 Apr 21 15:34:03 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 40/122] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:06 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-8b29d925-eb3f-4c65-bd61-e31d8fa61ffb tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-186743455"}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:06 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-8b29d925-eb3f-4c65-bd61-e31d8fa61ffb tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: d9cce6ca-aeb4-454a-83db-794936352483] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:06 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-8b29d925-eb3f-4c65-bd61-e31d8fa61ffb tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:06 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-8b29d925-eb3f-4c65-bd61-e31d8fa61ffb tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:06 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-8b29d925-eb3f-4c65-bd61-e31d8fa61ffb tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:06 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-8b29d925-eb3f-4c65-bd61-e31d8fa61ffb tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:06 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-8b29d925-eb3f-4c65-bd61-e31d8fa61ffb tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:06 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-8b29d925-eb3f-4c65-bd61-e31d8fa61ffb tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:06 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:06 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:07 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-8b29d925-eb3f-4c65-bd61-e31d8fa61ffb tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483/action" status: 202 len: 52 microversion: 2.87 time: 1.207326 Apr 21 15:34:07 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 44/123] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 21 15:34:06 2023] POST /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483/action => generated 52 bytes in 1209 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Apr 21 15:34:10 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:10 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-ce92756e-5a97-4a79-995f-8c89528c6649 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:10 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-ce92756e-5a97-4a79-995f-8c89528c6649 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ce92756e-5a97-4a79-995f-8c89528c6649 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ce92756e-5a97-4a79-995f-8c89528c6649 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ce92756e-5a97-4a79-995f-8c89528c6649 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ce92756e-5a97-4a79-995f-8c89528c6649 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ce92756e-5a97-4a79-995f-8c89528c6649 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ce92756e-5a97-4a79-995f-8c89528c6649 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:10 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-ce92756e-5a97-4a79-995f-8c89528c6649 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:34:10 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-ce92756e-5a97-4a79-995f-8c89528c6649 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1539 microversion: 2.1 time: 0.217376 Apr 21 15:34:10 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 40/124] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:34:10 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1539 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:34:11 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-72376da0-c281-4683-88f2-559106d029fd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:11 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-72376da0-c281-4683-88f2-559106d029fd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 33e531c7-1e26-4ed7-8899-c97983a0fc69] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-72376da0-c281-4683-88f2-559106d029fd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-72376da0-c281-4683-88f2-559106d029fd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-72376da0-c281-4683-88f2-559106d029fd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-72376da0-c281-4683-88f2-559106d029fd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-72376da0-c281-4683-88f2-559106d029fd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-72376da0-c281-4683-88f2-559106d029fd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:11 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-72376da0-c281-4683-88f2-559106d029fd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.154454 Apr 21 15:34:11 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 41/125] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 15:34:11 2023] GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69/os-interface => generated 282 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:12 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-460fc18b-24aa-4370-85e5-1bb65946698d tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:12 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-460fc18b-24aa-4370-85e5-1bb65946698d tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: d9cce6ca-aeb4-454a-83db-794936352483] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-460fc18b-24aa-4370-85e5-1bb65946698d tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-460fc18b-24aa-4370-85e5-1bb65946698d tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-460fc18b-24aa-4370-85e5-1bb65946698d tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-460fc18b-24aa-4370-85e5-1bb65946698d tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-460fc18b-24aa-4370-85e5-1bb65946698d tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-460fc18b-24aa-4370-85e5-1bb65946698d tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:13 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-aedec6a0-a324-407e-bad0-dcddcf641f28 req-806788f0-a580-4eb7-bb77-b0b3fd92b6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33e531c7-1e26-4ed7-8899-c97983a0fc69", "tag": "48c5fc84-8631-499b-a1c2-aade3a7569d2"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:13 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-aedec6a0-a324-407e-bad0-dcddcf641f28 req-806788f0-a580-4eb7-bb77-b0b3fd92b6c2 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:13 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-aedec6a0-a324-407e-bad0-dcddcf641f28 req-806788f0-a580-4eb7-bb77-b0b3fd92b6c2 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:13 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-aedec6a0-a324-407e-bad0-dcddcf641f28 req-806788f0-a580-4eb7-bb77-b0b3fd92b6c2 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:13 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-aedec6a0-a324-407e-bad0-dcddcf641f28 req-806788f0-a580-4eb7-bb77-b0b3fd92b6c2 service nova] Creating event network-changed:48c5fc84-8631-499b-a1c2-aade3a7569d2 for instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 on user Apr 21 15:34:13 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-aedec6a0-a324-407e-bad0-dcddcf641f28 req-806788f0-a580-4eb7-bb77-b0b3fd92b6c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045363 Apr 21 15:34:13 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 41/126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:13 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-460fc18b-24aa-4370-85e5-1bb65946698d tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:34:13 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-460fc18b-24aa-4370-85e5-1bb65946698d tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:34:13 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-460fc18b-24aa-4370-85e5-1bb65946698d tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:34:13 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-460fc18b-24aa-4370-85e5-1bb65946698d tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483" status: 200 len: 1691 microversion: 2.87 time: 0.324810 Apr 21 15:34:13 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 45/127] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:34:12 2023] GET /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483 => generated 1691 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:34:13 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-bcaa0d12-0f43-465b-8bda-2edde96d3708 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:13 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-bcaa0d12-0f43-465b-8bda-2edde96d3708 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 33e531c7-1e26-4ed7-8899-c97983a0fc69] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:13 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-bcaa0d12-0f43-465b-8bda-2edde96d3708 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:13 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-bcaa0d12-0f43-465b-8bda-2edde96d3708 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:13 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-bcaa0d12-0f43-465b-8bda-2edde96d3708 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:13 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-bcaa0d12-0f43-465b-8bda-2edde96d3708 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:13 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-bcaa0d12-0f43-465b-8bda-2edde96d3708 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:13 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-bcaa0d12-0f43-465b-8bda-2edde96d3708 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:13 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-bcaa0d12-0f43-465b-8bda-2edde96d3708 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69/ips" status: 200 len: 108 microversion: 2.1 time: 0.047210 Apr 21 15:34:13 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 42/128] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 15:34:13 2023] GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69/ips => generated 108 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:14 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-0d7a2a20-a719-4dcc-932b-dd6dd4713bc4 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:14 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-0d7a2a20-a719-4dcc-932b-dd6dd4713bc4 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 33e531c7-1e26-4ed7-8899-c97983a0fc69] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:14 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-0d7a2a20-a719-4dcc-932b-dd6dd4713bc4 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:14 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-0d7a2a20-a719-4dcc-932b-dd6dd4713bc4 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:14 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-0d7a2a20-a719-4dcc-932b-dd6dd4713bc4 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:14 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-0d7a2a20-a719-4dcc-932b-dd6dd4713bc4 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:14 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-0d7a2a20-a719-4dcc-932b-dd6dd4713bc4 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:14 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-0d7a2a20-a719-4dcc-932b-dd6dd4713bc4 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:14 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-0d7a2a20-a719-4dcc-932b-dd6dd4713bc4 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 33e531c7-1e26-4ed7-8899-c97983a0fc69] Going to try to terminate instance {{(pid=61512) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:34:14 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-0d7a2a20-a719-4dcc-932b-dd6dd4713bc4 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69" status: 204 len: 0 microversion: 2.1 time: 0.266860 Apr 21 15:34:14 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 42/129] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:34:14 2023] DELETE /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:34:14 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-dbd60d3a-4b47-4bfa-ad8d-ab79ec6315e1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:14 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-dbd60d3a-4b47-4bfa-ad8d-ab79ec6315e1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 33e531c7-1e26-4ed7-8899-c97983a0fc69] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:14 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dbd60d3a-4b47-4bfa-ad8d-ab79ec6315e1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:14 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dbd60d3a-4b47-4bfa-ad8d-ab79ec6315e1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:14 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dbd60d3a-4b47-4bfa-ad8d-ab79ec6315e1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:14 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dbd60d3a-4b47-4bfa-ad8d-ab79ec6315e1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:14 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dbd60d3a-4b47-4bfa-ad8d-ab79ec6315e1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:14 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dbd60d3a-4b47-4bfa-ad8d-ab79ec6315e1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:15 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-3fac5750-a271-46f5-99d8-505bb65d0956 req-8d803963-3ea5-4a79-a8b8-48f0bc6ca776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e531c7-1e26-4ed7-8899-c97983a0fc69", "name": "network-vif-unplugged", "status": "completed", "tag": "48c5fc84-8631-499b-a1c2-aade3a7569d2"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-3fac5750-a271-46f5-99d8-505bb65d0956 req-8d803963-3ea5-4a79-a8b8-48f0bc6ca776 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-3fac5750-a271-46f5-99d8-505bb65d0956 req-8d803963-3ea5-4a79-a8b8-48f0bc6ca776 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-3fac5750-a271-46f5-99d8-505bb65d0956 req-8d803963-3ea5-4a79-a8b8-48f0bc6ca776 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:15 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-dbd60d3a-4b47-4bfa-ad8d-ab79ec6315e1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b6dad090b84d0d9b0a8c3f6421a4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de04c4cc5f140c08c23e34065a9b59a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:34:15 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-dbd60d3a-4b47-4bfa-ad8d-ab79ec6315e1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69" status: 200 len: 1667 microversion: 2.1 time: 0.362105 Apr 21 15:34:15 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 46/130] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:34:14 2023] GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69 => generated 1667 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:34:15 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-3fac5750-a271-46f5-99d8-505bb65d0956 req-8d803963-3ea5-4a79-a8b8-48f0bc6ca776 service nova] Creating event network-vif-unplugged:48c5fc84-8631-499b-a1c2-aade3a7569d2 for instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 on user Apr 21 15:34:15 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-3fac5750-a271-46f5-99d8-505bb65d0956 req-8d803963-3ea5-4a79-a8b8-48f0bc6ca776 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040411 Apr 21 15:34:15 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 43/131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:16 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-99e0f5f7-7e1c-4bfd-b699-c2951cdc1d43 req-32a90da4-0222-4adb-86e5-370579b99392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e531c7-1e26-4ed7-8899-c97983a0fc69", "name": "network-vif-deleted", "tag": "48c5fc84-8631-499b-a1c2-aade3a7569d2"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:16 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-99e0f5f7-7e1c-4bfd-b699-c2951cdc1d43 req-32a90da4-0222-4adb-86e5-370579b99392 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:16 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-99e0f5f7-7e1c-4bfd-b699-c2951cdc1d43 req-32a90da4-0222-4adb-86e5-370579b99392 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:16 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-99e0f5f7-7e1c-4bfd-b699-c2951cdc1d43 req-32a90da4-0222-4adb-86e5-370579b99392 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:16 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-99e0f5f7-7e1c-4bfd-b699-c2951cdc1d43 req-32a90da4-0222-4adb-86e5-370579b99392 service nova] Creating event network-vif-deleted:48c5fc84-8631-499b-a1c2-aade3a7569d2 for instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 on user Apr 21 15:34:16 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-99e0f5f7-7e1c-4bfd-b699-c2951cdc1d43 req-32a90da4-0222-4adb-86e5-370579b99392 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042948 Apr 21 15:34:16 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 43/132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:17 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-ce8ccd0b-13a5-41ec-84d3-5e90b0c07b71 req-e4fe625a-5e86-48e0-a23c-0150eedbf32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33e531c7-1e26-4ed7-8899-c97983a0fc69", "name": "network-vif-plugged", "status": "completed", "tag": "48c5fc84-8631-499b-a1c2-aade3a7569d2"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:17 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-ce8ccd0b-13a5-41ec-84d3-5e90b0c07b71 req-e4fe625a-5e86-48e0-a23c-0150eedbf32f service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:17 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-ce8ccd0b-13a5-41ec-84d3-5e90b0c07b71 req-e4fe625a-5e86-48e0-a23c-0150eedbf32f service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:17 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-ce8ccd0b-13a5-41ec-84d3-5e90b0c07b71 req-e4fe625a-5e86-48e0-a23c-0150eedbf32f service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:17 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-ce8ccd0b-13a5-41ec-84d3-5e90b0c07b71 req-e4fe625a-5e86-48e0-a23c-0150eedbf32f service nova] Creating event network-vif-plugged:48c5fc84-8631-499b-a1c2-aade3a7569d2 for instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 on user Apr 21 15:34:17 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-ce8ccd0b-13a5-41ec-84d3-5e90b0c07b71 req-e4fe625a-5e86-48e0-a23c-0150eedbf32f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028537 Apr 21 15:34:17 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 47/133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:29 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=14 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:29 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:29 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f0d6c9b3-d340-4a9b-83e7-2cb5e644cc45 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:29 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f0d6c9b3-d340-4a9b-83e7-2cb5e644cc45 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] [instance: 415751ed-a1e9-4249-9fcb-e9d609818b17] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f0d6c9b3-d340-4a9b-83e7-2cb5e644cc45 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f0d6c9b3-d340-4a9b-83e7-2cb5e644cc45 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f0d6c9b3-d340-4a9b-83e7-2cb5e644cc45 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f0d6c9b3-d340-4a9b-83e7-2cb5e644cc45 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f0d6c9b3-d340-4a9b-83e7-2cb5e644cc45 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:29 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f0d6c9b3-d340-4a9b-83e7-2cb5e644cc45 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:29 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f0d6c9b3-d340-4a9b-83e7-2cb5e644cc45 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.181067 Apr 21 15:34:29 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 44/134] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 15:34:29 2023] GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17/os-interface => generated 282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:30 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:30 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:30 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-46039747-c677-4c38-9fb5-cd0c4b1b7284 req-76907712-c6e6-4e11-a5f7-a074fa61c191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415751ed-a1e9-4249-9fcb-e9d609818b17", "tag": "f9d8e336-0aae-4822-aa8f-896130992c81"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:30 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-46039747-c677-4c38-9fb5-cd0c4b1b7284 req-76907712-c6e6-4e11-a5f7-a074fa61c191 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:30 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-46039747-c677-4c38-9fb5-cd0c4b1b7284 req-76907712-c6e6-4e11-a5f7-a074fa61c191 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:30 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-46039747-c677-4c38-9fb5-cd0c4b1b7284 req-76907712-c6e6-4e11-a5f7-a074fa61c191 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:30 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-46039747-c677-4c38-9fb5-cd0c4b1b7284 req-76907712-c6e6-4e11-a5f7-a074fa61c191 service nova] Creating event network-changed:f9d8e336-0aae-4822-aa8f-896130992c81 for instance 415751ed-a1e9-4249-9fcb-e9d609818b17 on user Apr 21 15:34:30 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-46039747-c677-4c38-9fb5-cd0c4b1b7284 req-76907712-c6e6-4e11-a5f7-a074fa61c191 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037494 Apr 21 15:34:30 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 44/135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:32 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:32 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:32 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-bfaee9f2-e60b-442b-a2e5-bbccb76219f2 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:32 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-bfaee9f2-e60b-442b-a2e5-bbccb76219f2 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] [instance: 415751ed-a1e9-4249-9fcb-e9d609818b17] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:32 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-bfaee9f2-e60b-442b-a2e5-bbccb76219f2 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:32 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-bfaee9f2-e60b-442b-a2e5-bbccb76219f2 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:32 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-bfaee9f2-e60b-442b-a2e5-bbccb76219f2 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:32 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-bfaee9f2-e60b-442b-a2e5-bbccb76219f2 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:32 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-bfaee9f2-e60b-442b-a2e5-bbccb76219f2 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:32 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-bfaee9f2-e60b-442b-a2e5-bbccb76219f2 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:32 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-bfaee9f2-e60b-442b-a2e5-bbccb76219f2 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] [instance: 415751ed-a1e9-4249-9fcb-e9d609818b17] Going to try to terminate instance {{(pid=61511) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:34:32 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-bfaee9f2-e60b-442b-a2e5-bbccb76219f2 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17" status: 204 len: 0 microversion: 2.1 time: 0.130893 Apr 21 15:34:32 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 48/136] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:34:32 2023] DELETE /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:34:32 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-dfcd75c8-c8ae-4421-b352-a824ae96c841 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:32 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-dfcd75c8-c8ae-4421-b352-a824ae96c841 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] [instance: 415751ed-a1e9-4249-9fcb-e9d609818b17] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dfcd75c8-c8ae-4421-b352-a824ae96c841 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dfcd75c8-c8ae-4421-b352-a824ae96c841 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dfcd75c8-c8ae-4421-b352-a824ae96c841 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dfcd75c8-c8ae-4421-b352-a824ae96c841 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dfcd75c8-c8ae-4421-b352-a824ae96c841 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-dfcd75c8-c8ae-4421-b352-a824ae96c841 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:32 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-dfcd75c8-c8ae-4421-b352-a824ae96c841 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b7d38149c5e459a92d456ed03ab4beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fbad07c9b34d6693e5e0bd8394fd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:34:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-dfcd75c8-c8ae-4421-b352-a824ae96c841 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17" status: 200 len: 1672 microversion: 2.1 time: 0.171890 Apr 21 15:34:32 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 45/137] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:34:32 2023] GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17 => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:34:32 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-18b8abd2-a2ac-43fa-8a61-f65905d92cee req-d06f80e0-949d-42bc-baec-8b4a8fa8375b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415751ed-a1e9-4249-9fcb-e9d609818b17", "name": "network-vif-unplugged", "status": "completed", "tag": "f9d8e336-0aae-4822-aa8f-896130992c81"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:32 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-18b8abd2-a2ac-43fa-8a61-f65905d92cee req-d06f80e0-949d-42bc-baec-8b4a8fa8375b service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:32 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-18b8abd2-a2ac-43fa-8a61-f65905d92cee req-d06f80e0-949d-42bc-baec-8b4a8fa8375b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:32 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-18b8abd2-a2ac-43fa-8a61-f65905d92cee req-d06f80e0-949d-42bc-baec-8b4a8fa8375b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:32 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-18b8abd2-a2ac-43fa-8a61-f65905d92cee req-d06f80e0-949d-42bc-baec-8b4a8fa8375b service nova] Creating event network-vif-unplugged:f9d8e336-0aae-4822-aa8f-896130992c81 for instance 415751ed-a1e9-4249-9fcb-e9d609818b17 on user Apr 21 15:34:32 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-18b8abd2-a2ac-43fa-8a61-f65905d92cee req-d06f80e0-949d-42bc-baec-8b4a8fa8375b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031593 Apr 21 15:34:32 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 45/138] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:33 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-697391e1-2382-4af1-a4f7-e55cc39b81d8 req-ddfe1ed1-a1a1-4a90-b504-700b77a1a5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415751ed-a1e9-4249-9fcb-e9d609818b17", "name": "network-vif-deleted", "tag": "f9d8e336-0aae-4822-aa8f-896130992c81"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:33 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-697391e1-2382-4af1-a4f7-e55cc39b81d8 req-ddfe1ed1-a1a1-4a90-b504-700b77a1a5cf service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:33 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-697391e1-2382-4af1-a4f7-e55cc39b81d8 req-ddfe1ed1-a1a1-4a90-b504-700b77a1a5cf service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:33 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-697391e1-2382-4af1-a4f7-e55cc39b81d8 req-ddfe1ed1-a1a1-4a90-b504-700b77a1a5cf service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:33 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-697391e1-2382-4af1-a4f7-e55cc39b81d8 req-ddfe1ed1-a1a1-4a90-b504-700b77a1a5cf service nova] Creating event network-vif-deleted:f9d8e336-0aae-4822-aa8f-896130992c81 for instance 415751ed-a1e9-4249-9fcb-e9d609818b17 on user Apr 21 15:34:33 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-697391e1-2382-4af1-a4f7-e55cc39b81d8 req-ddfe1ed1-a1a1-4a90-b504-700b77a1a5cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034797 Apr 21 15:34:33 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 49/139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:34 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-06998b73-cb85-4927-9578-7869ed0cbb6f req-b7aae993-6648-4840-b5db-f35d84556443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415751ed-a1e9-4249-9fcb-e9d609818b17", "name": "network-vif-plugged", "status": "completed", "tag": "f9d8e336-0aae-4822-aa8f-896130992c81"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-06998b73-cb85-4927-9578-7869ed0cbb6f req-b7aae993-6648-4840-b5db-f35d84556443 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-06998b73-cb85-4927-9578-7869ed0cbb6f req-b7aae993-6648-4840-b5db-f35d84556443 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-06998b73-cb85-4927-9578-7869ed0cbb6f req-b7aae993-6648-4840-b5db-f35d84556443 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:34 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-06998b73-cb85-4927-9578-7869ed0cbb6f req-b7aae993-6648-4840-b5db-f35d84556443 service nova] Creating event network-vif-plugged:f9d8e336-0aae-4822-aa8f-896130992c81 for instance 415751ed-a1e9-4249-9fcb-e9d609818b17 on user Apr 21 15:34:34 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-06998b73-cb85-4927-9578-7869ed0cbb6f req-b7aae993-6648-4840-b5db-f35d84556443 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028426 Apr 21 15:34:34 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 46/140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:45 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:45 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:45 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-d7701116-73b0-4905-b6a1-8650fcacde76 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:45 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-d7701116-73b0-4905-b6a1-8650fcacde76 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] [instance: 728b5fa0-caca-423d-a105-7789d7c242bd] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d7701116-73b0-4905-b6a1-8650fcacde76 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d7701116-73b0-4905-b6a1-8650fcacde76 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d7701116-73b0-4905-b6a1-8650fcacde76 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d7701116-73b0-4905-b6a1-8650fcacde76 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d7701116-73b0-4905-b6a1-8650fcacde76 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d7701116-73b0-4905-b6a1-8650fcacde76 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:45 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-d7701116-73b0-4905-b6a1-8650fcacde76 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.207527 Apr 21 15:34:45 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 46/141] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 15:34:45 2023] GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd/os-interface => generated 282 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:46 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-dc6f195e-16e4-46bb-9cbc-78a1e9d21627 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:46 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-dc6f195e-16e4-46bb-9cbc-78a1e9d21627 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: 77788e0b-c833-42c0-ba9b-3e32dce614f5] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:46 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:46 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dc6f195e-16e4-46bb-9cbc-78a1e9d21627 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dc6f195e-16e4-46bb-9cbc-78a1e9d21627 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dc6f195e-16e4-46bb-9cbc-78a1e9d21627 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dc6f195e-16e4-46bb-9cbc-78a1e9d21627 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dc6f195e-16e4-46bb-9cbc-78a1e9d21627 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dc6f195e-16e4-46bb-9cbc-78a1e9d21627 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:46 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-dc6f195e-16e4-46bb-9cbc-78a1e9d21627 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c07c4b2ee5404db0ad5e5126dcdfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a34de8879c43bcb72b8eb70df45700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:34:46 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-dc6f195e-16e4-46bb-9cbc-78a1e9d21627 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5" status: 200 len: 1492 microversion: 2.1 time: 0.533558 Apr 21 15:34:46 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 50/142] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:34:46 2023] GET /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5 => generated 1492 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:34:47 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:47 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=12 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:47 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c2be1810-87e6-440e-b55a-3e5bf70ebde2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:47 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c2be1810-87e6-440e-b55a-3e5bf70ebde2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 662c333c-a6b4-4fec-90e5-3712fbebfc4d] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c2be1810-87e6-440e-b55a-3e5bf70ebde2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c2be1810-87e6-440e-b55a-3e5bf70ebde2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c2be1810-87e6-440e-b55a-3e5bf70ebde2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c2be1810-87e6-440e-b55a-3e5bf70ebde2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c2be1810-87e6-440e-b55a-3e5bf70ebde2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c2be1810-87e6-440e-b55a-3e5bf70ebde2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-faa802bc-5328-4bf2-b8b9-62b9be38031a req-ddcf5842-c4b2-4784-9b2e-e389117ea795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "728b5fa0-caca-423d-a105-7789d7c242bd", "tag": "b15324cd-b962-4849-85dc-175318b9011a"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-faa802bc-5328-4bf2-b8b9-62b9be38031a req-ddcf5842-c4b2-4784-9b2e-e389117ea795 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-faa802bc-5328-4bf2-b8b9-62b9be38031a req-ddcf5842-c4b2-4784-9b2e-e389117ea795 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-faa802bc-5328-4bf2-b8b9-62b9be38031a req-ddcf5842-c4b2-4784-9b2e-e389117ea795 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:47 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-faa802bc-5328-4bf2-b8b9-62b9be38031a req-ddcf5842-c4b2-4784-9b2e-e389117ea795 service nova] Creating event network-changed:b15324cd-b962-4849-85dc-175318b9011a for instance 728b5fa0-caca-423d-a105-7789d7c242bd on user Apr 21 15:34:47 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-faa802bc-5328-4bf2-b8b9-62b9be38031a req-ddcf5842-c4b2-4784-9b2e-e389117ea795 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035620 Apr 21 15:34:47 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 47/143] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:47 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-4f6e217d-4f74-4566-aa57-0f03398410fd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-640163298"}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:47 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-4f6e217d-4f74-4566-aa57-0f03398410fd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] [instance: 728b5fa0-caca-423d-a105-7789d7c242bd] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-4f6e217d-4f74-4566-aa57-0f03398410fd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-4f6e217d-4f74-4566-aa57-0f03398410fd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-4f6e217d-4f74-4566-aa57-0f03398410fd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-4f6e217d-4f74-4566-aa57-0f03398410fd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-4f6e217d-4f74-4566-aa57-0f03398410fd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-4f6e217d-4f74-4566-aa57-0f03398410fd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:47 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-c2be1810-87e6-440e-b55a-3e5bf70ebde2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e5168c1014774b77090a1eeb56abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9caeb7a6f3674392afae6edf987420fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:34:47 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c2be1810-87e6-440e-b55a-3e5bf70ebde2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d" status: 200 len: 1489 microversion: 2.1 time: 0.281190 Apr 21 15:34:47 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 47/144] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:34:47 2023] GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d => generated 1489 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-eb705dce-c9c2-47f4-87e7-35f8829699b7 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-eb705dce-c9c2-47f4-87e7-35f8829699b7 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] [instance: ab4f24f3-2688-4a47-938b-947b30c3694a] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb705dce-c9c2-47f4-87e7-35f8829699b7 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb705dce-c9c2-47f4-87e7-35f8829699b7 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb705dce-c9c2-47f4-87e7-35f8829699b7 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb705dce-c9c2-47f4-87e7-35f8829699b7 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb705dce-c9c2-47f4-87e7-35f8829699b7 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb705dce-c9c2-47f4-87e7-35f8829699b7 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:47 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-eb705dce-c9c2-47f4-87e7-35f8829699b7 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] HTTP exception thrown: Instance ab4f24f3-2688-4a47-938b-947b30c3694a could not be found. Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-eb705dce-c9c2-47f4-87e7-35f8829699b7 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Request method failure captured: Apr 21 15:34:47 user devstack@n-api.service[61512]: request: GET /compute/v2.1/servers/ab4f24f3-2688-4a47-938b-947b30c3694a HTTP/1.1 Apr 21 15:34:47 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:34:47 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:34:47 user devstack@n-api.service[61512]: Connection: close Apr 21 15:34:47 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:34:47 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:34:47 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:34:47 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:34:47 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQqxy7fa8rXCv1GebpaStG-yNBYgP4XtDlQM_EYzUPpHlS9KDSnyIMYIkSTCQuyIfmrwDI4lqgynNWByptpgDKQN7iKANAgmSXdD2Ob9rL-CIwY2sYT7bja8vfm4_NbBbsAxO134opfj0gwSifmxG4EUsAIQr8818vSX25HHhjigvePs Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Project-Id: 80135d0f2158413da39596602a3cdc02 Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Project-Name: tempest-DeleteServersTestJSON-681796085 Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/80135d0f2158413da39596602a3cdc02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/80135d0f2158413da39596602a3cdc02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/80135d0f2158413da39596602a3cdc02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Tenant: tempest-DeleteServersTestJSON-681796085 Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Tenant-Id: 80135d0f2158413da39596602a3cdc02 Apr 21 15:34:47 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-DeleteServersTestJSON-681796085 Apr 21 15:34:47 user devstack@n-api.service[61512]: X-User: tempest-DeleteServersTestJSON-681796085-project-member Apr 21 15:34:47 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:34:47 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:34:47 user devstack@n-api.service[61512]: X-User-Id: 06bf99010b5f45f2bfb834e3d6bb7f33 Apr 21 15:34:47 user devstack@n-api.service[61512]: X-User-Name: tempest-DeleteServersTestJSON-681796085-project-member Apr 21 15:34:47 user devstack@n-api.service[61512]: method: > Apr 21 15:34:47 user devstack@n-api.service[61512]: exception: Instance ab4f24f3-2688-4a47-938b-947b30c3694a could not be found. Apr 21 15:34:47 user devstack@n-api.service[61512]: action_args: {'id': 'ab4f24f3-2688-4a47-938b-947b30c3694a'} Apr 21 15:34:47 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab4f24f3-2688-4a47-938b-947b30c3694a could not be found. Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab4f24f3-2688-4a47-938b-947b30c3694a could not be found. Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab4f24f3-2688-4a47-938b-947b30c3694a could not be found. Apr 21 15:34:47 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:34:47 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-eb705dce-c9c2-47f4-87e7-35f8829699b7 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] Returning 404 to user: Instance ab4f24f3-2688-4a47-938b-947b30c3694a could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:34:47 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-eb705dce-c9c2-47f4-87e7-35f8829699b7 tempest-DeleteServersTestJSON-681796085 tempest-DeleteServersTestJSON-681796085-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab4f24f3-2688-4a47-938b-947b30c3694a" status: 404 len: 111 microversion: 2.1 time: 0.033489 Apr 21 15:34:47 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 48/145] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:34:47 2023] GET /compute/v2.1/servers/ab4f24f3-2688-4a47-938b-947b30c3694a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:34:47 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-4f6e217d-4f74-4566-aa57-0f03398410fd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "POST /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd/action" status: 202 len: 0 microversion: 2.1 time: 0.755165 Apr 21 15:34:47 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 51/146] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 21 15:34:47 2023] POST /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 21 15:34:47 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-e3b75502-9941-446d-87b5-9e5bcd1939bb tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '.version_select at 0x7f0c14853d00>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:48 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-e3b75502-9941-446d-87b5-9e5bcd1939bb tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "GET /compute/v2.1/images/fbb1260e-1b13-4c33-b43f-5bf52b0c31b9" status: 200 len: 1608 microversion: 2.1 time: 0.050269 Apr 21 15:34:48 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 48/147] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 21 15:34:47 2023] GET /compute/v2.1/images/fbb1260e-1b13-4c33-b43f-5bf52b0c31b9 => generated 1608 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1287615730", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "networks": [{"uuid": "6cc059d1-2309-41dc-960d-06802f0b1cda"}]}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG nova.network.neutron [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] validate_networks() for [('6cc059d1-2309-41dc-960d-06802f0b1cda', None, None, None, None, None)] {{(pid=61512) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Flavor limits 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Image limits 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Flavor pref 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Image pref 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:55 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Getting quotas for project 9d36e6b98eec4e29badb3a6c5d2c7bc7. Resources: {'ram', 'cores', 'instances'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:34:55 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Getting quotas for user 815d703557bc48b4b7bca89d62b8f66f and project 9d36e6b98eec4e29badb3a6c5d2c7bc7. Resources: {'ram', 'cores', 'instances'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:34:55 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Going to run 1 instances... {{(pid=61512) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:34:55 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] [instance: 39285a0d-d52f-43b4-a334-6793f7f749f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:34:55 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-1c1398f0-099a-4ff3-bf8f-f9cc98363965 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.687092 Apr 21 15:34:55 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 49/148] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:34:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:34:55 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-b2deb7a4-302f-4ccd-a02e-97dfd4fa5616 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:34:55 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-b2deb7a4-302f-4ccd-a02e-97dfd4fa5616 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] [instance: 39285a0d-d52f-43b4-a334-6793f7f749f4] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:34:55 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-b2deb7a4-302f-4ccd-a02e-97dfd4fa5616 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815d703557bc48b4b7bca89d62b8f66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e6b98eec4e29badb3a6c5d2c7bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:34:55 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-b2deb7a4-302f-4ccd-a02e-97dfd4fa5616 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39285a0d-d52f-43b4-a334-6793f7f749f4" status: 200 len: 1208 microversion: 2.1 time: 0.071524 Apr 21 15:34:55 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 52/149] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:34:55 2023] GET /compute/v2.1/servers/39285a0d-d52f-43b4-a334-6793f7f749f4 => generated 1208 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:34:57 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:57 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:34:57 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-54cc4b3a-2f57-44ea-86fb-9f334c81dc82 req-16bceb71-d61f-476d-bf73-8d328ed6e1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39285a0d-d52f-43b4-a334-6793f7f749f4", "tag": "d4ae87bd-e0df-465f-ba23-33e836eb17c9"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-54cc4b3a-2f57-44ea-86fb-9f334c81dc82 req-16bceb71-d61f-476d-bf73-8d328ed6e1e7 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-54cc4b3a-2f57-44ea-86fb-9f334c81dc82 req-16bceb71-d61f-476d-bf73-8d328ed6e1e7 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:57 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-54cc4b3a-2f57-44ea-86fb-9f334c81dc82 req-16bceb71-d61f-476d-bf73-8d328ed6e1e7 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:57 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-54cc4b3a-2f57-44ea-86fb-9f334c81dc82 req-16bceb71-d61f-476d-bf73-8d328ed6e1e7 service nova] Creating event network-changed:d4ae87bd-e0df-465f-ba23-33e836eb17c9 for instance 39285a0d-d52f-43b4-a334-6793f7f749f4 on user Apr 21 15:34:57 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-54cc4b3a-2f57-44ea-86fb-9f334c81dc82 req-16bceb71-d61f-476d-bf73-8d328ed6e1e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031370 Apr 21 15:34:57 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 49/150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:34:59 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-fce148dc-9a16-4d5c-924e-20e35cea283a req-fe136c60-5c3e-41b4-ad42-47da269b92bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39285a0d-d52f-43b4-a334-6793f7f749f4", "name": "network-vif-plugged", "status": "completed", "tag": "d4ae87bd-e0df-465f-ba23-33e836eb17c9"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:34:59 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-fce148dc-9a16-4d5c-924e-20e35cea283a req-fe136c60-5c3e-41b4-ad42-47da269b92bc service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:34:59 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-fce148dc-9a16-4d5c-924e-20e35cea283a req-fe136c60-5c3e-41b4-ad42-47da269b92bc service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:34:59 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-fce148dc-9a16-4d5c-924e-20e35cea283a req-fe136c60-5c3e-41b4-ad42-47da269b92bc service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:34:59 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-fce148dc-9a16-4d5c-924e-20e35cea283a req-fe136c60-5c3e-41b4-ad42-47da269b92bc service nova] Creating event network-vif-plugged:d4ae87bd-e0df-465f-ba23-33e836eb17c9 for instance 39285a0d-d52f-43b4-a334-6793f7f749f4 on user Apr 21 15:34:59 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-fce148dc-9a16-4d5c-924e-20e35cea283a req-fe136c60-5c3e-41b4-ad42-47da269b92bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027698 Apr 21 15:34:59 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 50/151] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:34:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:01 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-30bd96f3-cef2-47ff-810b-28c460b66775 req-04d20c66-15ee-48a4-85cd-d11fff97666c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39285a0d-d52f-43b4-a334-6793f7f749f4", "name": "network-vif-plugged", "status": "completed", "tag": "d4ae87bd-e0df-465f-ba23-33e836eb17c9"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:01 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-30bd96f3-cef2-47ff-810b-28c460b66775 req-04d20c66-15ee-48a4-85cd-d11fff97666c service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-30bd96f3-cef2-47ff-810b-28c460b66775 req-04d20c66-15ee-48a4-85cd-d11fff97666c service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-30bd96f3-cef2-47ff-810b-28c460b66775 req-04d20c66-15ee-48a4-85cd-d11fff97666c service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:01 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-30bd96f3-cef2-47ff-810b-28c460b66775 req-04d20c66-15ee-48a4-85cd-d11fff97666c service nova] Creating event network-vif-plugged:d4ae87bd-e0df-465f-ba23-33e836eb17c9 for instance 39285a0d-d52f-43b4-a334-6793f7f749f4 on user Apr 21 15:35:01 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-30bd96f3-cef2-47ff-810b-28c460b66775 req-04d20c66-15ee-48a4-85cd-d11fff97666c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030709 Apr 21 15:35:01 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 53/152] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:35:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:05 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c02f16bf-7a5b-4f24-b8d1-d956db4dbe29 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:05 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c02f16bf-7a5b-4f24-b8d1-d956db4dbe29 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 33e531c7-1e26-4ed7-8899-c97983a0fc69] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c02f16bf-7a5b-4f24-b8d1-d956db4dbe29 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c02f16bf-7a5b-4f24-b8d1-d956db4dbe29 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c02f16bf-7a5b-4f24-b8d1-d956db4dbe29 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c02f16bf-7a5b-4f24-b8d1-d956db4dbe29 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c02f16bf-7a5b-4f24-b8d1-d956db4dbe29 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c02f16bf-7a5b-4f24-b8d1-d956db4dbe29 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:05 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-c02f16bf-7a5b-4f24-b8d1-d956db4dbe29 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] HTTP exception thrown: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:35:05 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c02f16bf-7a5b-4f24-b8d1-d956db4dbe29 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Request method failure captured: Apr 21 15:35:05 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69 HTTP/1.1 Apr 21 15:35:05 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:35:05 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:35:05 user devstack@n-api.service[61510]: Connection: close Apr 21 15:35:05 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:35:05 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:35:05 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:35:05 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:35:05 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqx8Gv7A-nqSAxci8ycp4bbjS21DnMHkubeZnlMzsuQ0IBs11Wmb27W5yh2wwvRCHkCHY7yBeH8-pQxB3a-c2hsGt6JN6XHGMSjsy0Fh6iZLI5XRX1SKCNaeZpuA03MEBX57sfF0vk3cO2wpitA70pLWrYX7k-fSZN-4IF_VSKkALKQ Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Project-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Tenant-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:35:05 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:35:05 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:35:05 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:35:05 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:35:05 user devstack@n-api.service[61510]: X-User-Id: 27b6dad090b84d0d9b0a8c3f6421a4b0 Apr 21 15:35:05 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:35:05 user devstack@n-api.service[61510]: method: > Apr 21 15:35:05 user devstack@n-api.service[61510]: exception: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:35:05 user devstack@n-api.service[61510]: action_args: {'id': '33e531c7-1e26-4ed7-8899-c97983a0fc69'} Apr 21 15:35:05 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:35:05 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:05 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c02f16bf-7a5b-4f24-b8d1-d956db4dbe29 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Returning 404 to user: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:35:05 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c02f16bf-7a5b-4f24-b8d1-d956db4dbe29 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69" status: 404 len: 111 microversion: 2.1 time: 0.033546 Apr 21 15:35:05 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 50/153] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:35:05 2023] GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:35:05 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:05 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=6 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:05 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-4c8c5ee4-a8eb-4dc3-8f66-2b5ca0ced6dc tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '.version_select at 0x7f0c14652b90>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:05 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-4c8c5ee4-a8eb-4dc3-8f66-2b5ca0ced6dc tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-520324050" status: 202 len: 0 microversion: 2.1 time: 0.033027 Apr 21 15:35:05 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 51/154] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 15:35:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-520324050 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:35:06 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:06 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-bd96f9aa-be68-4dba-8379-c4022f237e00 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Action: 'create', calling method: .version_select at 0x7f0c1489f130>, body: {"keypair": {"name": "tempest-keypair-1874569475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS4dNYLPrFWim0798uDj5jYiOvHqWHStXEVfFWa0sSLmHA6OL0nLWWQ4GNeKf3xkTGY3XgNKiWLfTVetYS+Ke4HP17hHoQUgK+mitDd2HwN8pJjGGArlqnFKodMNqDu/Q=="}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:06 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-bd96f9aa-be68-4dba-8379-c4022f237e00 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Getting quotas for project 9de04c4cc5f140c08c23e34065a9b59a. Resources: {'key_pairs'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:35:06 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-bd96f9aa-be68-4dba-8379-c4022f237e00 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Getting quotas for user 27b6dad090b84d0d9b0a8c3f6421a4b0 and project 9de04c4cc5f140c08c23e34065a9b59a. Resources: {'key_pairs'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:35:06 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-bd96f9aa-be68-4dba-8379-c4022f237e00 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056787 Apr 21 15:35:06 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 54/155] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:35:06 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-371192790", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "df728346-27f5-4b62-955a-45e68bcde88d"}], "security_groups": [{"name": "tempest-securitygroup--887142689"}], "key_name": "tempest-keypair-1874569475", "user_data": "}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] validate_networks() for [('df728346-27f5-4b62-955a-45e68bcde88d', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:08 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Getting quotas for project 9de04c4cc5f140c08c23e34065a9b59a. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:35:08 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Getting quotas for user 27b6dad090b84d0d9b0a8c3f6421a4b0 and project 9de04c4cc5f140c08c23e34065a9b59a. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:35:08 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:35:08 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 4861f0f0-4b0b-485b-888b-f876d6136a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:35:08 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-2cc06446-3a33-4bd7-a769-fb0dd5b70d9b tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.654874 Apr 21 15:35:08 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 51/156] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:35:07 2023] POST /compute/v2.1/servers => generated 399 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 21 15:35:08 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-1c8e1c44-0cd6-4071-a3d3-049cbfe726bf tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:08 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-1c8e1c44-0cd6-4071-a3d3-049cbfe726bf tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 4861f0f0-4b0b-485b-888b-f876d6136a0e] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:08 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-1c8e1c44-0cd6-4071-a3d3-049cbfe726bf tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b6dad090b84d0d9b0a8c3f6421a4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de04c4cc5f140c08c23e34065a9b59a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:35:08 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-1c8e1c44-0cd6-4071-a3d3-049cbfe726bf tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e" status: 200 len: 1235 microversion: 2.1 time: 0.058396 Apr 21 15:35:08 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:35:08 2023] GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e => generated 1235 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:35:10 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-e10d2b53-7c3a-4f97-91c7-2ecff11c0e0e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:10 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-e10d2b53-7c3a-4f97-91c7-2ecff11c0e0e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:10 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e10d2b53-7c3a-4f97-91c7-2ecff11c0e0e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:10 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e10d2b53-7c3a-4f97-91c7-2ecff11c0e0e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:10 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e10d2b53-7c3a-4f97-91c7-2ecff11c0e0e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:10 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e10d2b53-7c3a-4f97-91c7-2ecff11c0e0e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:10 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e10d2b53-7c3a-4f97-91c7-2ecff11c0e0e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:10 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e10d2b53-7c3a-4f97-91c7-2ecff11c0e0e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:10 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-e10d2b53-7c3a-4f97-91c7-2ecff11c0e0e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.177433 Apr 21 15:35:10 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 55/158] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 15:35:10 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859/os-interface => generated 283 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:10 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-2ec6180e-7898-4b81-98cf-00f249c78513 req-43180ed7-d61c-4d22-8b62-f9ab5a7d02c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4861f0f0-4b0b-485b-888b-f876d6136a0e", "tag": "771917d1-f8bf-43be-baf5-a82873b18a73"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:10 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-2ec6180e-7898-4b81-98cf-00f249c78513 req-43180ed7-d61c-4d22-8b62-f9ab5a7d02c4 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:10 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-2ec6180e-7898-4b81-98cf-00f249c78513 req-43180ed7-d61c-4d22-8b62-f9ab5a7d02c4 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:10 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-2ec6180e-7898-4b81-98cf-00f249c78513 req-43180ed7-d61c-4d22-8b62-f9ab5a7d02c4 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:10 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-2ec6180e-7898-4b81-98cf-00f249c78513 req-43180ed7-d61c-4d22-8b62-f9ab5a7d02c4 service nova] Creating event network-changed:771917d1-f8bf-43be-baf5-a82873b18a73 for instance 4861f0f0-4b0b-485b-888b-f876d6136a0e on user Apr 21 15:35:10 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-2ec6180e-7898-4b81-98cf-00f249c78513 req-43180ed7-d61c-4d22-8b62-f9ab5a7d02c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031987 Apr 21 15:35:10 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 52/159] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:35:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:12 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-7fb2032e-eb12-4708-ad3c-e20f7b5a4e23 req-5470b79d-ad70-4ed6-93a9-71a7b8704043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6e1f23-e822-4a09-81f3-7e20ba206859", "tag": "323ad3b5-ae92-4ce7-856c-e9d50ba56c97"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:12 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=12 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-7fb2032e-eb12-4708-ad3c-e20f7b5a4e23 req-5470b79d-ad70-4ed6-93a9-71a7b8704043 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-7fb2032e-eb12-4708-ad3c-e20f7b5a4e23 req-5470b79d-ad70-4ed6-93a9-71a7b8704043 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:12 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-7fb2032e-eb12-4708-ad3c-e20f7b5a4e23 req-5470b79d-ad70-4ed6-93a9-71a7b8704043 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:12 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-7fb2032e-eb12-4708-ad3c-e20f7b5a4e23 req-5470b79d-ad70-4ed6-93a9-71a7b8704043 service nova] Creating event network-changed:323ad3b5-ae92-4ce7-856c-e9d50ba56c97 for instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 on user Apr 21 15:35:12 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-7fb2032e-eb12-4708-ad3c-e20f7b5a4e23 req-5470b79d-ad70-4ed6-93a9-71a7b8704043 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029330 Apr 21 15:35:12 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 53/160] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:35:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:12 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-33f9917f-9b68-4774-9950-7c08bceaf19e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:12 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-33f9917f-9b68-4774-9950-7c08bceaf19e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-33f9917f-9b68-4774-9950-7c08bceaf19e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-33f9917f-9b68-4774-9950-7c08bceaf19e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-33f9917f-9b68-4774-9950-7c08bceaf19e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-33f9917f-9b68-4774-9950-7c08bceaf19e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-33f9917f-9b68-4774-9950-7c08bceaf19e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-33f9917f-9b68-4774-9950-7c08bceaf19e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:12 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-33f9917f-9b68-4774-9950-7c08bceaf19e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:35:12 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-33f9917f-9b68-4774-9950-7c08bceaf19e tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1539 microversion: 2.1 time: 0.167826 Apr 21 15:35:12 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 56/161] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:35:12 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1539 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:35:12 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-56040e95-4847-4b44-a0b3-24f61d7237d6 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:12 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-56040e95-4847-4b44-a0b3-24f61d7237d6 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-56040e95-4847-4b44-a0b3-24f61d7237d6 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-56040e95-4847-4b44-a0b3-24f61d7237d6 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-56040e95-4847-4b44-a0b3-24f61d7237d6 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-56040e95-4847-4b44-a0b3-24f61d7237d6 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-56040e95-4847-4b44-a0b3-24f61d7237d6 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:12 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-56040e95-4847-4b44-a0b3-24f61d7237d6 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:12 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-56040e95-4847-4b44-a0b3-24f61d7237d6 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:35:12 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-56040e95-4847-4b44-a0b3-24f61d7237d6 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1539 microversion: 2.1 time: 0.414968 Apr 21 15:35:12 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 53/162] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:35:12 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1539 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2069963421", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "d9985060-7ec3-46f0-88bf-4d31d3a04bb5"}]}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG nova.network.neutron [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] validate_networks() for [('d9985060-7ec3-46f0-88bf-4d31d3a04bb5', None, None, None, None, None)] {{(pid=61512) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Flavor limits 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Image limits 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Flavor pref 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Image pref 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Getting quotas for project 0a0f7bbaef144dd48802a9fec82525fc. Resources: {'ram', 'cores', 'instances'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Getting quotas for user e2bcea96817e44e0b433b42e617329a1 and project 0a0f7bbaef144dd48802a9fec82525fc. Resources: {'ram', 'cores', 'instances'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Going to run 1 instances... {{(pid=61512) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:35:13 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:35:13 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-3ed7559f-7e44-46a1-818a-eccea1208355 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.550604 Apr 21 15:35:13 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 54/163] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 15:35:13 2023] POST /compute/v2.1/servers => generated 378 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 15:35:13 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-891c4bc3-4ea0-468f-bfa0-fdeda9fd3e7f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:13 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-891c4bc3-4ea0-468f-bfa0-fdeda9fd3e7f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:13 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-891c4bc3-4ea0-468f-bfa0-fdeda9fd3e7f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:35:13 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-891c4bc3-4ea0-468f-bfa0-fdeda9fd3e7f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:35:13 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-891c4bc3-4ea0-468f-bfa0-fdeda9fd3e7f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:35:13 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-891c4bc3-4ea0-468f-bfa0-fdeda9fd3e7f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17965888-828a-461b-98f3-1e608d4c8663" status: 200 len: 1395 microversion: 2.87 time: 0.073943 Apr 21 15:35:13 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 57/164] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:35:13 2023] GET /compute/v2.1/servers/17965888-828a-461b-98f3-1e608d4c8663 => generated 1395 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:35:14 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-ea65dbca-b503-4402-b23a-b46ee11d4267 req-b368f9f0-2f75-44a8-a480-46270b11bb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4861f0f0-4b0b-485b-888b-f876d6136a0e", "name": "network-vif-plugged", "status": "completed", "tag": "771917d1-f8bf-43be-baf5-a82873b18a73"}, {"server_uuid": "4861f0f0-4b0b-485b-888b-f876d6136a0e", "name": "network-vif-plugged", "status": "completed", "tag": "771917d1-f8bf-43be-baf5-a82873b18a73"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-ea65dbca-b503-4402-b23a-b46ee11d4267 req-b368f9f0-2f75-44a8-a480-46270b11bb04 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-ea65dbca-b503-4402-b23a-b46ee11d4267 req-b368f9f0-2f75-44a8-a480-46270b11bb04 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-ea65dbca-b503-4402-b23a-b46ee11d4267 req-b368f9f0-2f75-44a8-a480-46270b11bb04 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:14 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-ea65dbca-b503-4402-b23a-b46ee11d4267 req-b368f9f0-2f75-44a8-a480-46270b11bb04 service nova] Creating event network-vif-plugged:771917d1-f8bf-43be-baf5-a82873b18a73 for instance 4861f0f0-4b0b-485b-888b-f876d6136a0e on user Apr 21 15:35:14 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-ea65dbca-b503-4402-b23a-b46ee11d4267 req-b368f9f0-2f75-44a8-a480-46270b11bb04 service nova] Creating event network-vif-plugged:771917d1-f8bf-43be-baf5-a82873b18a73 for instance 4861f0f0-4b0b-485b-888b-f876d6136a0e on user Apr 21 15:35:14 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-ea65dbca-b503-4402-b23a-b46ee11d4267 req-b368f9f0-2f75-44a8-a480-46270b11bb04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031393 Apr 21 15:35:14 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 54/165] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:35:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 15:35:16 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-53473d30-2719-4ee0-99aa-8b490fce1be5 req-3f6c7c20-5567-4dc6-8fe5-a41cba31eac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17965888-828a-461b-98f3-1e608d4c8663", "tag": "ac4b1693-eb99-46f7-901d-2c988730ee33"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:16 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:16 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-53473d30-2719-4ee0-99aa-8b490fce1be5 req-3f6c7c20-5567-4dc6-8fe5-a41cba31eac5 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:16 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-53473d30-2719-4ee0-99aa-8b490fce1be5 req-3f6c7c20-5567-4dc6-8fe5-a41cba31eac5 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:16 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-53473d30-2719-4ee0-99aa-8b490fce1be5 req-3f6c7c20-5567-4dc6-8fe5-a41cba31eac5 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:16 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-53473d30-2719-4ee0-99aa-8b490fce1be5 req-3f6c7c20-5567-4dc6-8fe5-a41cba31eac5 service nova] Creating event network-changed:ac4b1693-eb99-46f7-901d-2c988730ee33 for instance 17965888-828a-461b-98f3-1e608d4c8663 on user Apr 21 15:35:16 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-53473d30-2719-4ee0-99aa-8b490fce1be5 req-3f6c7c20-5567-4dc6-8fe5-a41cba31eac5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030487 Apr 21 15:35:16 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 55/166] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:35:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:17 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-e6da915a-340f-4afd-b06d-cbc6b298124e req-6769bec3-3e46-4256-a33b-07cca0aacda3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17965888-828a-461b-98f3-1e608d4c8663", "name": "network-vif-deleted", "tag": "ac4b1693-eb99-46f7-901d-2c988730ee33"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:17 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:17 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e6da915a-340f-4afd-b06d-cbc6b298124e req-6769bec3-3e46-4256-a33b-07cca0aacda3 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:17 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e6da915a-340f-4afd-b06d-cbc6b298124e req-6769bec3-3e46-4256-a33b-07cca0aacda3 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:17 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e6da915a-340f-4afd-b06d-cbc6b298124e req-6769bec3-3e46-4256-a33b-07cca0aacda3 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:17 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.compute.server_external_events [req-e6da915a-340f-4afd-b06d-cbc6b298124e req-6769bec3-3e46-4256-a33b-07cca0aacda3 service nova] Unable to find a host for instance 17965888-828a-461b-98f3-1e608d4c8663. Dropping event network-vif-deleted {{(pid=61511) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 21 15:35:17 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-e6da915a-340f-4afd-b06d-cbc6b298124e req-6769bec3-3e46-4256-a33b-07cca0aacda3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.026968 Apr 21 15:35:17 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 58/167] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:35:17 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 21 15:35:22 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:22 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:22 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-5674fbd7-14a7-4c1b-a98a-5ce83aedf066 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:22 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-5674fbd7-14a7-4c1b-a98a-5ce83aedf066 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] [instance: 415751ed-a1e9-4249-9fcb-e9d609818b17] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-5674fbd7-14a7-4c1b-a98a-5ce83aedf066 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-5674fbd7-14a7-4c1b-a98a-5ce83aedf066 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-5674fbd7-14a7-4c1b-a98a-5ce83aedf066 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-5674fbd7-14a7-4c1b-a98a-5ce83aedf066 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-5674fbd7-14a7-4c1b-a98a-5ce83aedf066 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:22 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-5674fbd7-14a7-4c1b-a98a-5ce83aedf066 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:22 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-5674fbd7-14a7-4c1b-a98a-5ce83aedf066 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] HTTP exception thrown: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:22 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-5674fbd7-14a7-4c1b-a98a-5ce83aedf066 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Request method failure captured: Apr 21 15:35:22 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17 HTTP/1.1 Apr 21 15:35:22 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:35:22 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:35:22 user devstack@n-api.service[61510]: Connection: close Apr 21 15:35:22 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:35:22 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:35:22 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:35:22 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:35:22 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqx5AsoE9-mo5nmPYf9UNN6lS84fYjdssjA4MozCzDmfGp3X221SzJCCj1jYEvBNeQ2J9b9HL2eiSljI9MkkWghbG0lY5gOMmOAU3H5pnGDkcsxNcQDNot-ai9_NSVGE8sM8kaUlmwi4kwrNyyv3RpnVz-7eEeDTLWkyemNHfcZNf7Q Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Project-Id: 94fbad07c9b34d6693e5e0bd8394fd31 Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-655041358 Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94fbad07c9b34d6693e5e0bd8394fd31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94fbad07c9b34d6693e5e0bd8394fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94fbad07c9b34d6693e5e0bd8394fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-655041358 Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Tenant-Id: 94fbad07c9b34d6693e5e0bd8394fd31 Apr 21 15:35:22 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-655041358 Apr 21 15:35:22 user devstack@n-api.service[61510]: X-User: tempest-AttachSCSIVolumeTestJSON-655041358-project-member Apr 21 15:35:22 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:35:22 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:35:22 user devstack@n-api.service[61510]: X-User-Id: 2b7d38149c5e459a92d456ed03ab4beb Apr 21 15:35:22 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-655041358-project-member Apr 21 15:35:22 user devstack@n-api.service[61510]: method: > Apr 21 15:35:22 user devstack@n-api.service[61510]: exception: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:22 user devstack@n-api.service[61510]: action_args: {'id': '415751ed-a1e9-4249-9fcb-e9d609818b17'} Apr 21 15:35:22 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:22 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:22 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-5674fbd7-14a7-4c1b-a98a-5ce83aedf066 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Returning 404 to user: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:35:22 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-5674fbd7-14a7-4c1b-a98a-5ce83aedf066 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17" status: 404 len: 111 microversion: 2.1 time: 0.033885 Apr 21 15:35:22 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 55/168] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:35:22 2023] GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:35:22 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-731891b7-d498-4b80-8491-6e8cded0ba0a tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Calling method '.version_select at 0x7f0c148b9cf0>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:22 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-731891b7-d498-4b80-8491-6e8cded0ba0a tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631879295" status: 202 len: 0 microversion: 2.1 time: 0.021887 Apr 21 15:35:22 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 56/169] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 15:35:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631879295 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:35:23 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-5f3aeb3d-2ef6-40c0-8634-568eafdb5104 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:23 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-5f3aeb3d-2ef6-40c0-8634-568eafdb5104 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] [instance: 415751ed-a1e9-4249-9fcb-e9d609818b17] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-5f3aeb3d-2ef6-40c0-8634-568eafdb5104 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-5f3aeb3d-2ef6-40c0-8634-568eafdb5104 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-5f3aeb3d-2ef6-40c0-8634-568eafdb5104 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-5f3aeb3d-2ef6-40c0-8634-568eafdb5104 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-5f3aeb3d-2ef6-40c0-8634-568eafdb5104 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-5f3aeb3d-2ef6-40c0-8634-568eafdb5104 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:23 user devstack@n-api.service[61511]: INFO nova.api.openstack.wsgi [None req-5f3aeb3d-2ef6-40c0-8634-568eafdb5104 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] HTTP exception thrown: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:23 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-5f3aeb3d-2ef6-40c0-8634-568eafdb5104 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Request method failure captured: Apr 21 15:35:23 user devstack@n-api.service[61511]: request: DELETE /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17 HTTP/1.1 Apr 21 15:35:23 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:35:23 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:35:23 user devstack@n-api.service[61511]: Connection: close Apr 21 15:35:23 user devstack@n-api.service[61511]: Content-Length: 0 Apr 21 15:35:23 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:35:23 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:35:23 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:35:23 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQqx5AsoE9-mo5nmPYf9UNN6lS84fYjdssjA4MozCzDmfGp3X221SzJCCj1jYEvBNeQ2J9b9HL2eiSljI9MkkWghbG0lY5gOMmOAU3H5pnGDkcsxNcQDNot-ai9_NSVGE8sM8kaUlmwi4kwrNyyv3RpnVz-7eEeDTLWkyemNHfcZNf7Q Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Project-Id: 94fbad07c9b34d6693e5e0bd8394fd31 Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-655041358 Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94fbad07c9b34d6693e5e0bd8394fd31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94fbad07c9b34d6693e5e0bd8394fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94fbad07c9b34d6693e5e0bd8394fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-655041358 Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Tenant-Id: 94fbad07c9b34d6693e5e0bd8394fd31 Apr 21 15:35:23 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-655041358 Apr 21 15:35:23 user devstack@n-api.service[61511]: X-User: tempest-AttachSCSIVolumeTestJSON-655041358-project-member Apr 21 15:35:23 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:35:23 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:35:23 user devstack@n-api.service[61511]: X-User-Id: 2b7d38149c5e459a92d456ed03ab4beb Apr 21 15:35:23 user devstack@n-api.service[61511]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-655041358-project-member Apr 21 15:35:23 user devstack@n-api.service[61511]: method: > Apr 21 15:35:23 user devstack@n-api.service[61511]: exception: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:23 user devstack@n-api.service[61511]: action_args: {'id': '415751ed-a1e9-4249-9fcb-e9d609818b17'} Apr 21 15:35:23 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:35:23 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-5f3aeb3d-2ef6-40c0-8634-568eafdb5104 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Returning 404 to user: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:35:23 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-5f3aeb3d-2ef6-40c0-8634-568eafdb5104 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17" status: 404 len: 111 microversion: 2.1 time: 0.033845 Apr 21 15:35:23 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 59/170] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:35:23 2023] DELETE /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:35:23 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-deb4abe0-1861-4cd5-b611-84a55aa44845 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:23 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-deb4abe0-1861-4cd5-b611-84a55aa44845 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] [instance: 415751ed-a1e9-4249-9fcb-e9d609818b17] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-deb4abe0-1861-4cd5-b611-84a55aa44845 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-deb4abe0-1861-4cd5-b611-84a55aa44845 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-deb4abe0-1861-4cd5-b611-84a55aa44845 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-deb4abe0-1861-4cd5-b611-84a55aa44845 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-deb4abe0-1861-4cd5-b611-84a55aa44845 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-deb4abe0-1861-4cd5-b611-84a55aa44845 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:23 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-deb4abe0-1861-4cd5-b611-84a55aa44845 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] HTTP exception thrown: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:23 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-deb4abe0-1861-4cd5-b611-84a55aa44845 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Request method failure captured: Apr 21 15:35:23 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17 HTTP/1.1 Apr 21 15:35:23 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:35:23 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:35:23 user devstack@n-api.service[61510]: Connection: close Apr 21 15:35:23 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:35:23 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:35:23 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:35:23 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:35:23 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqx5AsoE9-mo5nmPYf9UNN6lS84fYjdssjA4MozCzDmfGp3X221SzJCCj1jYEvBNeQ2J9b9HL2eiSljI9MkkWghbG0lY5gOMmOAU3H5pnGDkcsxNcQDNot-ai9_NSVGE8sM8kaUlmwi4kwrNyyv3RpnVz-7eEeDTLWkyemNHfcZNf7Q Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Project-Id: 94fbad07c9b34d6693e5e0bd8394fd31 Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-655041358 Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94fbad07c9b34d6693e5e0bd8394fd31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/94fbad07c9b34d6693e5e0bd8394fd31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/94fbad07c9b34d6693e5e0bd8394fd31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-655041358 Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Tenant-Id: 94fbad07c9b34d6693e5e0bd8394fd31 Apr 21 15:35:23 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-655041358 Apr 21 15:35:23 user devstack@n-api.service[61510]: X-User: tempest-AttachSCSIVolumeTestJSON-655041358-project-member Apr 21 15:35:23 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:35:23 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:35:23 user devstack@n-api.service[61510]: X-User-Id: 2b7d38149c5e459a92d456ed03ab4beb Apr 21 15:35:23 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-655041358-project-member Apr 21 15:35:23 user devstack@n-api.service[61510]: method: > Apr 21 15:35:23 user devstack@n-api.service[61510]: exception: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:23 user devstack@n-api.service[61510]: action_args: {'id': '415751ed-a1e9-4249-9fcb-e9d609818b17'} Apr 21 15:35:23 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. Apr 21 15:35:23 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:35:23 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-deb4abe0-1861-4cd5-b611-84a55aa44845 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] Returning 404 to user: Instance 415751ed-a1e9-4249-9fcb-e9d609818b17 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:35:23 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-deb4abe0-1861-4cd5-b611-84a55aa44845 tempest-AttachSCSIVolumeTestJSON-655041358 tempest-AttachSCSIVolumeTestJSON-655041358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17" status: 404 len: 111 microversion: 2.1 time: 0.028518 Apr 21 15:35:23 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 56/171] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:35:23 2023] GET /compute/v2.1/servers/415751ed-a1e9-4249-9fcb-e9d609818b17 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:35:38 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:38 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=8 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:38 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=6 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:38 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:38 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-006a1a0c-fd63-4ec4-9ad7-47e52a4e351e tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '.version_select at 0x7f0c15ae2b90>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:38 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-006a1a0c-fd63-4ec4-9ad7-47e52a4e351e tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "GET /compute/v2.1/images/fbb1260e-1b13-4c33-b43f-5bf52b0c31b9" status: 200 len: 1722 microversion: 2.1 time: 0.059985 Apr 21 15:35:38 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 57/172] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 21 15:35:38 2023] GET /compute/v2.1/images/fbb1260e-1b13-4c33-b43f-5bf52b0c31b9 => generated 1722 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:35:38 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-73d138df-1e03-4b96-976f-e6990a691b79 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '.version_select at 0x7f0c14690790>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:38 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:38 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=3 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:38 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=16 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:38 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-73d138df-1e03-4b96-976f-e6990a691b79 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "GET /compute/v2.1/images/fbb1260e-1b13-4c33-b43f-5bf52b0c31b9" status: 200 len: 1722 microversion: 2.1 time: 0.076975 Apr 21 15:35:38 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 60/173] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 21 15:35:38 2023] GET /compute/v2.1/images/fbb1260e-1b13-4c33-b43f-5bf52b0c31b9 => generated 1722 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:35:38 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-7a6c5365-c891-4980-8387-b957bbef03dd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:38 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-7a6c5365-c891-4980-8387-b957bbef03dd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] [instance: 728b5fa0-caca-423d-a105-7789d7c242bd] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:38 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:38 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=20 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-7a6c5365-c891-4980-8387-b957bbef03dd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-7a6c5365-c891-4980-8387-b957bbef03dd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-7a6c5365-c891-4980-8387-b957bbef03dd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-7a6c5365-c891-4980-8387-b957bbef03dd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-7a6c5365-c891-4980-8387-b957bbef03dd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-7a6c5365-c891-4980-8387-b957bbef03dd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:38 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-7a6c5365-c891-4980-8387-b957bbef03dd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c901c0ffdf6e42f2a9c826aecb667d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4825737e417473f930a05f796980264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:35:38 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-7a6c5365-c891-4980-8387-b957bbef03dd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd" status: 200 len: 1671 microversion: 2.1 time: 0.223598 Apr 21 15:35:38 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 57/174] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:35:38 2023] GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd => generated 1671 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:35:44 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-8e432db3-4853-43cd-ac7f-121a37f9faa1 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Action: 'create', calling method: .version_select at 0x7f0c146524d0>, body: {"keypair": {"name": "tempest-keypair-1378947070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUxsV8wEFRYKYOmLhxYJb6oL9JUFYwzD3F8wgBgYfiNzASf9pB8jmu77fQyNlzXREgOP/s4SMyDlVSPOWE15ewGCNSOqTfgcBdcsThDTZ1QuqgGVZnErU/1erwE75XtdA=="}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:44 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-8e432db3-4853-43cd-ac7f-121a37f9faa1 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Getting quotas for project 78462ef768874f1e96974e457bcb0198. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:35:44 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-8e432db3-4853-43cd-ac7f-121a37f9faa1 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Getting quotas for user 125905d0824740b98235b346068bdb97 and project 78462ef768874f1e96974e457bcb0198. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:35:44 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-8e432db3-4853-43cd-ac7f-121a37f9faa1 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.304098 Apr 21 15:35:44 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 58/175] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:35:44 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:45 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-f2e27ec4-4588-46d0-8e4d-cb419204ce6b tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:45 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-f2e27ec4-4588-46d0-8e4d-cb419204ce6b tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] [instance: 39285a0d-d52f-43b4-a334-6793f7f749f4] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f2e27ec4-4588-46d0-8e4d-cb419204ce6b tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f2e27ec4-4588-46d0-8e4d-cb419204ce6b tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f2e27ec4-4588-46d0-8e4d-cb419204ce6b tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f2e27ec4-4588-46d0-8e4d-cb419204ce6b tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f2e27ec4-4588-46d0-8e4d-cb419204ce6b tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f2e27ec4-4588-46d0-8e4d-cb419204ce6b tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:45 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-f2e27ec4-4588-46d0-8e4d-cb419204ce6b tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815d703557bc48b4b7bca89d62b8f66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e6b98eec4e29badb3a6c5d2c7bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:35:45 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-f2e27ec4-4588-46d0-8e4d-cb419204ce6b tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39285a0d-d52f-43b4-a334-6793f7f749f4" status: 200 len: 1487 microversion: 2.1 time: 0.316739 Apr 21 15:35:45 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 61/176] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:35:45 2023] GET /compute/v2.1/servers/39285a0d-d52f-43b4-a334-6793f7f749f4 => generated 1487 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:35:45 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1511735460", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "networks": [{"uuid": "4a3a11bc-176c-4ff5-ab17-33bb5d0c9b96"}], "security_groups": [{"name": "tempest-securitygroup--1438379526"}], "key_name": "tempest-keypair-1378947070", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] validate_networks() for [('4a3a11bc-176c-4ff5-ab17-33bb5d0c9b96', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Getting quotas for project 78462ef768874f1e96974e457bcb0198. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Getting quotas for user 125905d0824740b98235b346068bdb97 and project 78462ef768874f1e96974e457bcb0198. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:35:46 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 1570e80b-42fe-48de-a976-f821fdab5f9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:35:46 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-1ed821fb-15e7-40e1-bf05-9b29de18d365 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.605136 Apr 21 15:35:46 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 58/177] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:35:45 2023] POST /compute/v2.1/servers => generated 404 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:35:46 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-919ef07e-ba2b-4441-a5a3-5437432ece00 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:46 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-919ef07e-ba2b-4441-a5a3-5437432ece00 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 1570e80b-42fe-48de-a976-f821fdab5f9b] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:46 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-919ef07e-ba2b-4441-a5a3-5437432ece00 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125905d0824740b98235b346068bdb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78462ef768874f1e96974e457bcb0198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:35:46 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-919ef07e-ba2b-4441-a5a3-5437432ece00 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b" status: 200 len: 1236 microversion: 2.1 time: 0.103387 Apr 21 15:35:46 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 59/178] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:35:46 2023] GET /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-ba5a920e-24a9-4557-bb97-2a6b6320d1d8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-ba5a920e-24a9-4557-bb97-2a6b6320d1d8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: 77788e0b-c833-42c0-ba9b-3e32dce614f5] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ba5a920e-24a9-4557-bb97-2a6b6320d1d8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ba5a920e-24a9-4557-bb97-2a6b6320d1d8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ba5a920e-24a9-4557-bb97-2a6b6320d1d8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ba5a920e-24a9-4557-bb97-2a6b6320d1d8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ba5a920e-24a9-4557-bb97-2a6b6320d1d8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ba5a920e-24a9-4557-bb97-2a6b6320d1d8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-ba5a920e-24a9-4557-bb97-2a6b6320d1d8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: 77788e0b-c833-42c0-ba9b-3e32dce614f5] Going to try to terminate instance {{(pid=61511) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:35:47 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-ba5a920e-24a9-4557-bb97-2a6b6320d1d8 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5" status: 204 len: 0 microversion: 2.1 time: 0.113972 Apr 21 15:35:47 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 62/179] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:35:47 2023] DELETE /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:35:47 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-bda42112-e1fe-44f4-b5d0-fcc3638cd796 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:47 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-bda42112-e1fe-44f4-b5d0-fcc3638cd796 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: 77788e0b-c833-42c0-ba9b-3e32dce614f5] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-bda42112-e1fe-44f4-b5d0-fcc3638cd796 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-bda42112-e1fe-44f4-b5d0-fcc3638cd796 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-bda42112-e1fe-44f4-b5d0-fcc3638cd796 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-bda42112-e1fe-44f4-b5d0-fcc3638cd796 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-bda42112-e1fe-44f4-b5d0-fcc3638cd796 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-bda42112-e1fe-44f4-b5d0-fcc3638cd796 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-fe73851d-56ba-4d0a-9bdf-366ff10b7816 req-a69a2dd1-60f9-48d3-95df-91ff59846c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77788e0b-c833-42c0-ba9b-3e32dce614f5", "name": "network-vif-unplugged", "status": "completed", "tag": "6ec169dd-b4f2-4aa2-aaa4-0f0907b8143c"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:47 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-3b3884e0-f79d-4e26-9d54-ac3a8d3cf23a tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:47 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-3b3884e0-f79d-4e26-9d54-ac3a8d3cf23a tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 2da62263-7d42-447d-abee-597a75abb16f] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-fe73851d-56ba-4d0a-9bdf-366ff10b7816 req-a69a2dd1-60f9-48d3-95df-91ff59846c18 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-fe73851d-56ba-4d0a-9bdf-366ff10b7816 req-a69a2dd1-60f9-48d3-95df-91ff59846c18 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-fe73851d-56ba-4d0a-9bdf-366ff10b7816 req-a69a2dd1-60f9-48d3-95df-91ff59846c18 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3b3884e0-f79d-4e26-9d54-ac3a8d3cf23a tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3b3884e0-f79d-4e26-9d54-ac3a8d3cf23a tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3b3884e0-f79d-4e26-9d54-ac3a8d3cf23a tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3b3884e0-f79d-4e26-9d54-ac3a8d3cf23a tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3b3884e0-f79d-4e26-9d54-ac3a8d3cf23a tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3b3884e0-f79d-4e26-9d54-ac3a8d3cf23a tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:47 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-fe73851d-56ba-4d0a-9bdf-366ff10b7816 req-a69a2dd1-60f9-48d3-95df-91ff59846c18 service nova] Creating event network-vif-unplugged:6ec169dd-b4f2-4aa2-aaa4-0f0907b8143c for instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 on user Apr 21 15:35:47 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-fe73851d-56ba-4d0a-9bdf-366ff10b7816 req-a69a2dd1-60f9-48d3-95df-91ff59846c18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029226 Apr 21 15:35:47 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 63/180] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:35:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 15:35:47 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-bda42112-e1fe-44f4-b5d0-fcc3638cd796 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c07c4b2ee5404db0ad5e5126dcdfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a34de8879c43bcb72b8eb70df45700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:35:47 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-bda42112-e1fe-44f4-b5d0-fcc3638cd796 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5" status: 200 len: 1498 microversion: 2.1 time: 0.358344 Apr 21 15:35:47 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 59/181] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:35:47 2023] GET /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5 => generated 1498 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:35:47 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-3b3884e0-f79d-4e26-9d54-ac3a8d3cf23a tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e5168c1014774b77090a1eeb56abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9caeb7a6f3674392afae6edf987420fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:35:47 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-3b3884e0-f79d-4e26-9d54-ac3a8d3cf23a tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2da62263-7d42-447d-abee-597a75abb16f" status: 200 len: 1503 microversion: 2.1 time: 0.448380 Apr 21 15:35:47 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 60/182] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:35:47 2023] GET /compute/v2.1/servers/2da62263-7d42-447d-abee-597a75abb16f => generated 1503 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:35:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-631c659d-fd57-4d8f-bce5-2a9a2dc3aabf req-27545a34-249a-4cac-abea-ab83b022d252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77788e0b-c833-42c0-ba9b-3e32dce614f5", "name": "network-vif-deleted", "tag": "6ec169dd-b4f2-4aa2-aaa4-0f0907b8143c"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:48 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-631c659d-fd57-4d8f-bce5-2a9a2dc3aabf req-27545a34-249a-4cac-abea-ab83b022d252 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:48 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-631c659d-fd57-4d8f-bce5-2a9a2dc3aabf req-27545a34-249a-4cac-abea-ab83b022d252 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:48 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-631c659d-fd57-4d8f-bce5-2a9a2dc3aabf req-27545a34-249a-4cac-abea-ab83b022d252 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:48 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-631c659d-fd57-4d8f-bce5-2a9a2dc3aabf req-27545a34-249a-4cac-abea-ab83b022d252 service nova] Creating event network-vif-deleted:6ec169dd-b4f2-4aa2-aaa4-0f0907b8143c for instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 on user Apr 21 15:35:48 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-631c659d-fd57-4d8f-bce5-2a9a2dc3aabf req-27545a34-249a-4cac-abea-ab83b022d252 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042588 Apr 21 15:35:48 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 64/183] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:35:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:49 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-becef95c-b5dc-4e65-9b3c-37503620b0ce req-91a55a83-d148-4388-a452-5f5b2040e1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77788e0b-c833-42c0-ba9b-3e32dce614f5", "name": "network-vif-plugged", "status": "completed", "tag": "6ec169dd-b4f2-4aa2-aaa4-0f0907b8143c"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-becef95c-b5dc-4e65-9b3c-37503620b0ce req-91a55a83-d148-4388-a452-5f5b2040e1d8 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-becef95c-b5dc-4e65-9b3c-37503620b0ce req-91a55a83-d148-4388-a452-5f5b2040e1d8 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-becef95c-b5dc-4e65-9b3c-37503620b0ce req-91a55a83-d148-4388-a452-5f5b2040e1d8 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:49 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-becef95c-b5dc-4e65-9b3c-37503620b0ce req-91a55a83-d148-4388-a452-5f5b2040e1d8 service nova] Creating event network-vif-plugged:6ec169dd-b4f2-4aa2-aaa4-0f0907b8143c for instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 on user Apr 21 15:35:49 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-becef95c-b5dc-4e65-9b3c-37503620b0ce req-91a55a83-d148-4388-a452-5f5b2040e1d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028358 Apr 21 15:35:49 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 60/184] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:35:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:49 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-19776b10-ed65-4415-b1f5-143f4e470cab req-de8f8a1c-49e2-4a2f-aaa7-86498ba6e94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1570e80b-42fe-48de-a976-f821fdab5f9b", "tag": "606f098b-357f-46e2-b2fc-5be513fb6b35"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:49 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-19776b10-ed65-4415-b1f5-143f4e470cab req-de8f8a1c-49e2-4a2f-aaa7-86498ba6e94c service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:49 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-19776b10-ed65-4415-b1f5-143f4e470cab req-de8f8a1c-49e2-4a2f-aaa7-86498ba6e94c service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:49 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-19776b10-ed65-4415-b1f5-143f4e470cab req-de8f8a1c-49e2-4a2f-aaa7-86498ba6e94c service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:49 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-19776b10-ed65-4415-b1f5-143f4e470cab req-de8f8a1c-49e2-4a2f-aaa7-86498ba6e94c service nova] Creating event network-changed:606f098b-357f-46e2-b2fc-5be513fb6b35 for instance 1570e80b-42fe-48de-a976-f821fdab5f9b on user Apr 21 15:35:49 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-19776b10-ed65-4415-b1f5-143f4e470cab req-de8f8a1c-49e2-4a2f-aaa7-86498ba6e94c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041558 Apr 21 15:35:49 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 61/185] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:35:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:51 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-cdb372ce-fb28-40d7-8709-d78729a9f4eb req-a68f2732-2aff-4348-8d75-e16c66f0c7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1570e80b-42fe-48de-a976-f821fdab5f9b", "name": "network-vif-plugged", "status": "completed", "tag": "606f098b-357f-46e2-b2fc-5be513fb6b35"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:51 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-cdb372ce-fb28-40d7-8709-d78729a9f4eb req-a68f2732-2aff-4348-8d75-e16c66f0c7f1 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:51 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-cdb372ce-fb28-40d7-8709-d78729a9f4eb req-a68f2732-2aff-4348-8d75-e16c66f0c7f1 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:51 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-cdb372ce-fb28-40d7-8709-d78729a9f4eb req-a68f2732-2aff-4348-8d75-e16c66f0c7f1 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:51 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-cdb372ce-fb28-40d7-8709-d78729a9f4eb req-a68f2732-2aff-4348-8d75-e16c66f0c7f1 service nova] Creating event network-vif-plugged:606f098b-357f-46e2-b2fc-5be513fb6b35 for instance 1570e80b-42fe-48de-a976-f821fdab5f9b on user Apr 21 15:35:51 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-cdb372ce-fb28-40d7-8709-d78729a9f4eb req-a68f2732-2aff-4348-8d75-e16c66f0c7f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043741 Apr 21 15:35:51 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 65/186] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:35:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:53 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-8bf2f1ff-03b1-43f7-9262-8dc77af0e8f4 req-9c7c26fd-2136-4da6-ad61-31c8148a64ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1570e80b-42fe-48de-a976-f821fdab5f9b", "name": "network-vif-plugged", "status": "completed", "tag": "606f098b-357f-46e2-b2fc-5be513fb6b35"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:35:53 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-8bf2f1ff-03b1-43f7-9262-8dc77af0e8f4 req-9c7c26fd-2136-4da6-ad61-31c8148a64ee service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:53 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-8bf2f1ff-03b1-43f7-9262-8dc77af0e8f4 req-9c7c26fd-2136-4da6-ad61-31c8148a64ee service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:53 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-8bf2f1ff-03b1-43f7-9262-8dc77af0e8f4 req-9c7c26fd-2136-4da6-ad61-31c8148a64ee service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:53 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-8bf2f1ff-03b1-43f7-9262-8dc77af0e8f4 req-9c7c26fd-2136-4da6-ad61-31c8148a64ee service nova] Creating event network-vif-plugged:606f098b-357f-46e2-b2fc-5be513fb6b35 for instance 1570e80b-42fe-48de-a976-f821fdab5f9b on user Apr 21 15:35:53 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-8bf2f1ff-03b1-43f7-9262-8dc77af0e8f4 req-9c7c26fd-2136-4da6-ad61-31c8148a64ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031881 Apr 21 15:35:53 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 61/187] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:35:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:35:58 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=6 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:35:58 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-1e0c4a40-1f28-49f0-bf9d-4840d7227d40 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:35:58 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-1e0c4a40-1f28-49f0-bf9d-4840d7227d40 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 4861f0f0-4b0b-485b-888b-f876d6136a0e] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:35:58 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1e0c4a40-1f28-49f0-bf9d-4840d7227d40 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:58 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1e0c4a40-1f28-49f0-bf9d-4840d7227d40 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:58 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1e0c4a40-1f28-49f0-bf9d-4840d7227d40 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:58 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1e0c4a40-1f28-49f0-bf9d-4840d7227d40 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:35:58 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1e0c4a40-1f28-49f0-bf9d-4840d7227d40 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:35:58 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1e0c4a40-1f28-49f0-bf9d-4840d7227d40 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:35:58 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-1e0c4a40-1f28-49f0-bf9d-4840d7227d40 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b6dad090b84d0d9b0a8c3f6421a4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de04c4cc5f140c08c23e34065a9b59a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:35:58 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-1e0c4a40-1f28-49f0-bf9d-4840d7227d40 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e" status: 200 len: 1544 microversion: 2.1 time: 0.230972 Apr 21 15:35:58 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 62/188] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:35:58 2023] GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e => generated 1544 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:36:02 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:02 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:02 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-21544686-84ae-4d98-952d-e46d30c48206 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:02 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-21544686-84ae-4d98-952d-e46d30c48206 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:02 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-21544686-84ae-4d98-952d-e46d30c48206 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:02 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-21544686-84ae-4d98-952d-e46d30c48206 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:02 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-21544686-84ae-4d98-952d-e46d30c48206 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:02 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-21544686-84ae-4d98-952d-e46d30c48206 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:02 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-21544686-84ae-4d98-952d-e46d30c48206 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:02 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-21544686-84ae-4d98-952d-e46d30c48206 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:03 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-21544686-84ae-4d98-952d-e46d30c48206 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:03 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-21544686-84ae-4d98-952d-e46d30c48206 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1657 microversion: 2.1 time: 0.307448 Apr 21 15:36:03 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 66/189] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:36:02 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1657 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:36:03 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:03 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-8be4bb32-9ec8-43dd-9798-95ef9465a10f tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:03 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-8be4bb32-9ec8-43dd-9798-95ef9465a10f tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8be4bb32-9ec8-43dd-9798-95ef9465a10f tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8be4bb32-9ec8-43dd-9798-95ef9465a10f tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8be4bb32-9ec8-43dd-9798-95ef9465a10f tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8be4bb32-9ec8-43dd-9798-95ef9465a10f tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8be4bb32-9ec8-43dd-9798-95ef9465a10f tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8be4bb32-9ec8-43dd-9798-95ef9465a10f tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:03 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-8be4bb32-9ec8-43dd-9798-95ef9465a10f tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-8be4bb32-9ec8-43dd-9798-95ef9465a10f tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1657 microversion: 2.1 time: 0.243890 Apr 21 15:36:03 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 62/190] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:36:03 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1657 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:36:03 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG nova.objects.instance [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lazy-loading 'fault' on Instance uuid 17965888-828a-461b-98f3-1e608d4c8663 {{(pid=61512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:04 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:04 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-eb6a83b6-0ca7-4b6b-b6cd-0b1f973c20b2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17965888-828a-461b-98f3-1e608d4c8663" status: 200 len: 1650 microversion: 2.87 time: 0.151696 Apr 21 15:36:04 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 63/191] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:36:03 2023] GET /compute/v2.1/servers/17965888-828a-461b-98f3-1e608d4c8663 => generated 1650 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] Going to try to terminate instance {{(pid=61511) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] Doing local delete in cell ec9e962f-7b82-4673-844a-78caa9c9d46e(cell1) {{(pid=61511) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:04 user devstack@n-api.service[61511]: WARNING nova.compute.api [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] instance's host None is down, deleting from database Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] deallocate_for_instance() {{(pid=61511) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] Instance cache missing network info. {{(pid=61511) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] Updating instance_info_cache with network_info: [] {{(pid=61511) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 21 15:36:04 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61511) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 21 15:36:04 user devstack@n-api.service[61511]: WARNING nova.compute.api [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 21 15:36:04 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-447e4a6e-3ea9-4041-8f81-1e50a361b232 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/17965888-828a-461b-98f3-1e608d4c8663" status: 204 len: 0 microversion: 2.87 time: 0.759353 Apr 21 15:36:04 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 67/192] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 15:36:04 2023] DELETE /compute/v2.1/servers/17965888-828a-461b-98f3-1e608d4c8663 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 15:36:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-1eccb8c1-d4c1-43fc-b84f-d206b25eb865 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:04 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-1eccb8c1-d4c1-43fc-b84f-d206b25eb865 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: 17965888-828a-461b-98f3-1e608d4c8663] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1eccb8c1-d4c1-43fc-b84f-d206b25eb865 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1eccb8c1-d4c1-43fc-b84f-d206b25eb865 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1eccb8c1-d4c1-43fc-b84f-d206b25eb865 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1eccb8c1-d4c1-43fc-b84f-d206b25eb865 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1eccb8c1-d4c1-43fc-b84f-d206b25eb865 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1eccb8c1-d4c1-43fc-b84f-d206b25eb865 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-1eccb8c1-d4c1-43fc-b84f-d206b25eb865 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] HTTP exception thrown: Instance 17965888-828a-461b-98f3-1e608d4c8663 could not be found. Apr 21 15:36:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-1eccb8c1-d4c1-43fc-b84f-d206b25eb865 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Request method failure captured: Apr 21 15:36:04 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/17965888-828a-461b-98f3-1e608d4c8663 HTTP/1.1 Apr 21 15:36:04 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:36:04 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:36:04 user devstack@n-api.service[61510]: Connection: close Apr 21 15:36:04 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:36:04 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:36:04 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:36:04 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:36:04 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqx8v9Hl2zY9jRtYJOk1vIfUY22TEtCPbc9dahYopYaiC_kIYnV3nnJXyz8oM_1neATFYCxoUk_PmozLRRnQt4RJxGYpqApdH-QZkIK9bCNGNXORiP_wp42fwy48UwJYl-EGmfK-eqGtpcBUZ8QmtVAbuoGLE40pCQGgSvr4Yf46wFg Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Openstack-Nova-Api-Version: 2.87 Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Project-Id: 0a0f7bbaef144dd48802a9fec82525fc Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1467086537 Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a0f7bbaef144dd48802a9fec82525fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a0f7bbaef144dd48802a9fec82525fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a0f7bbaef144dd48802a9fec82525fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1467086537 Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Tenant-Id: 0a0f7bbaef144dd48802a9fec82525fc Apr 21 15:36:04 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1467086537 Apr 21 15:36:04 user devstack@n-api.service[61510]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member Apr 21 15:36:04 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:36:04 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:36:04 user devstack@n-api.service[61510]: X-User-Id: e2bcea96817e44e0b433b42e617329a1 Apr 21 15:36:04 user devstack@n-api.service[61510]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member Apr 21 15:36:04 user devstack@n-api.service[61510]: method: > Apr 21 15:36:04 user devstack@n-api.service[61510]: exception: Instance 17965888-828a-461b-98f3-1e608d4c8663 could not be found. Apr 21 15:36:04 user devstack@n-api.service[61510]: action_args: {'id': '17965888-828a-461b-98f3-1e608d4c8663'} Apr 21 15:36:04 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17965888-828a-461b-98f3-1e608d4c8663 could not be found. Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17965888-828a-461b-98f3-1e608d4c8663 could not be found. Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17965888-828a-461b-98f3-1e608d4c8663 could not be found. Apr 21 15:36:04 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:36:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-1eccb8c1-d4c1-43fc-b84f-d206b25eb865 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Returning 404 to user: Instance 17965888-828a-461b-98f3-1e608d4c8663 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:36:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-1eccb8c1-d4c1-43fc-b84f-d206b25eb865 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17965888-828a-461b-98f3-1e608d4c8663" status: 404 len: 111 microversion: 2.87 time: 0.031742 Apr 21 15:36:04 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 63/193] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:36:04 2023] GET /compute/v2.1/servers/17965888-828a-461b-98f3-1e608d4c8663 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1027840057", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "networks": [{"uuid": "d9985060-7ec3-46f0-88bf-4d31d3a04bb5"}]}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG nova.network.neutron [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] validate_networks() for [('d9985060-7ec3-46f0-88bf-4d31d3a04bb5', None, None, None, None, None)] {{(pid=61512) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Flavor limits 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Image limits 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Flavor pref 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Image pref 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Getting quotas for project 0a0f7bbaef144dd48802a9fec82525fc. Resources: {'ram', 'cores', 'instances'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Getting quotas for user e2bcea96817e44e0b433b42e617329a1 and project 0a0f7bbaef144dd48802a9fec82525fc. Resources: {'ram', 'cores', 'instances'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Going to run 1 instances... {{(pid=61512) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:36:05 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: a2d2b868-5cc3-4349-850e-0246b1836705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:36:05 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-ed955f29-0034-419d-8f71-7641e05b682f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.698854 Apr 21 15:36:05 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 64/194] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 15:36:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 15:36:05 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-43141608-7678-4e51-b738-61a8e5ec83c2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:05 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-43141608-7678-4e51-b738-61a8e5ec83c2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: a2d2b868-5cc3-4349-850e-0246b1836705] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:05 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-43141608-7678-4e51-b738-61a8e5ec83c2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:05 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-43141608-7678-4e51-b738-61a8e5ec83c2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:05 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-43141608-7678-4e51-b738-61a8e5ec83c2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:05 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-43141608-7678-4e51-b738-61a8e5ec83c2 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705" status: 200 len: 1395 microversion: 2.87 time: 0.079021 Apr 21 15:36:05 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 68/195] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:36:05 2023] GET /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705 => generated 1395 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:36:08 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-df32c1a8-ac6a-4f63-8ab7-3bd9e3eae969 req-fba3071e-6f95-4b6f-8a37-dd5d78c3825d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2d2b868-5cc3-4349-850e-0246b1836705", "tag": "5966b9ed-8548-40d4-995e-efb217999946"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:36:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-df32c1a8-ac6a-4f63-8ab7-3bd9e3eae969 req-fba3071e-6f95-4b6f-8a37-dd5d78c3825d service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-df32c1a8-ac6a-4f63-8ab7-3bd9e3eae969 req-fba3071e-6f95-4b6f-8a37-dd5d78c3825d service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-df32c1a8-ac6a-4f63-8ab7-3bd9e3eae969 req-fba3071e-6f95-4b6f-8a37-dd5d78c3825d service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:08 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-df32c1a8-ac6a-4f63-8ab7-3bd9e3eae969 req-fba3071e-6f95-4b6f-8a37-dd5d78c3825d service nova] Creating event network-changed:5966b9ed-8548-40d4-995e-efb217999946 for instance a2d2b868-5cc3-4349-850e-0246b1836705 on user Apr 21 15:36:08 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-df32c1a8-ac6a-4f63-8ab7-3bd9e3eae969 req-fba3071e-6f95-4b6f-8a37-dd5d78c3825d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033539 Apr 21 15:36:08 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 64/196] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:36:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:36:10 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-4a969c4d-063c-4864-85ac-bf3690b7a5c5 req-f67aecfe-5cbb-4f8e-8d82-82fe45ac80ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d2b868-5cc3-4349-850e-0246b1836705", "name": "network-vif-plugged", "status": "completed", "tag": "5966b9ed-8548-40d4-995e-efb217999946"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:36:10 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-4a969c4d-063c-4864-85ac-bf3690b7a5c5 req-f67aecfe-5cbb-4f8e-8d82-82fe45ac80ae service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-4a969c4d-063c-4864-85ac-bf3690b7a5c5 req-f67aecfe-5cbb-4f8e-8d82-82fe45ac80ae service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-4a969c4d-063c-4864-85ac-bf3690b7a5c5 req-f67aecfe-5cbb-4f8e-8d82-82fe45ac80ae service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:10 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=25 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:10 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-4a969c4d-063c-4864-85ac-bf3690b7a5c5 req-f67aecfe-5cbb-4f8e-8d82-82fe45ac80ae service nova] Creating event network-vif-plugged:5966b9ed-8548-40d4-995e-efb217999946 for instance a2d2b868-5cc3-4349-850e-0246b1836705 on user Apr 21 15:36:10 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-4a969c4d-063c-4864-85ac-bf3690b7a5c5 req-f67aecfe-5cbb-4f8e-8d82-82fe45ac80ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043386 Apr 21 15:36:10 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 65/197] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:36:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:36:12 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-4f8d90b2-c595-49e9-9f1d-f04fe82106d5 req-e1b00c5e-458b-4685-969e-31000076b062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d2b868-5cc3-4349-850e-0246b1836705", "name": "network-vif-plugged", "status": "completed", "tag": "5966b9ed-8548-40d4-995e-efb217999946"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:36:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-4f8d90b2-c595-49e9-9f1d-f04fe82106d5 req-e1b00c5e-458b-4685-969e-31000076b062 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-4f8d90b2-c595-49e9-9f1d-f04fe82106d5 req-e1b00c5e-458b-4685-969e-31000076b062 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:12 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-4f8d90b2-c595-49e9-9f1d-f04fe82106d5 req-e1b00c5e-458b-4685-969e-31000076b062 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:12 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-4f8d90b2-c595-49e9-9f1d-f04fe82106d5 req-e1b00c5e-458b-4685-969e-31000076b062 service nova] Creating event network-vif-plugged:5966b9ed-8548-40d4-995e-efb217999946 for instance a2d2b868-5cc3-4349-850e-0246b1836705 on user Apr 21 15:36:12 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-4f8d90b2-c595-49e9-9f1d-f04fe82106d5 req-e1b00c5e-458b-4685-969e-31000076b062 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033837 Apr 21 15:36:12 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 69/198] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:36:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:36:36 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:36 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=28 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:36 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c8438826-f91c-4525-919e-71f8882674c5 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:36 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c8438826-f91c-4525-919e-71f8882674c5 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 1570e80b-42fe-48de-a976-f821fdab5f9b] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:36 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c8438826-f91c-4525-919e-71f8882674c5 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:36 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c8438826-f91c-4525-919e-71f8882674c5 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:36 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c8438826-f91c-4525-919e-71f8882674c5 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:36 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c8438826-f91c-4525-919e-71f8882674c5 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:36 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c8438826-f91c-4525-919e-71f8882674c5 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:36 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c8438826-f91c-4525-919e-71f8882674c5 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:36 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-c8438826-f91c-4525-919e-71f8882674c5 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125905d0824740b98235b346068bdb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78462ef768874f1e96974e457bcb0198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:36 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c8438826-f91c-4525-919e-71f8882674c5 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b" status: 200 len: 1546 microversion: 2.1 time: 0.234640 Apr 21 15:36:36 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 65/199] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:36:36 2023] GET /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b => generated 1546 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=6 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-d4a0091f-5e61-4b17-ac76-f20166c1d40d tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-d4a0091f-5e61-4b17-ac76-f20166c1d40d tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: 77788e0b-c833-42c0-ba9b-3e32dce614f5] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d4a0091f-5e61-4b17-ac76-f20166c1d40d tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d4a0091f-5e61-4b17-ac76-f20166c1d40d tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d4a0091f-5e61-4b17-ac76-f20166c1d40d tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d4a0091f-5e61-4b17-ac76-f20166c1d40d tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d4a0091f-5e61-4b17-ac76-f20166c1d40d tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d4a0091f-5e61-4b17-ac76-f20166c1d40d tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:37 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-d4a0091f-5e61-4b17-ac76-f20166c1d40d tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] HTTP exception thrown: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-d4a0091f-5e61-4b17-ac76-f20166c1d40d tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Request method failure captured: Apr 21 15:36:37 user devstack@n-api.service[61512]: request: GET /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5 HTTP/1.1 Apr 21 15:36:37 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:36:37 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:36:37 user devstack@n-api.service[61512]: Connection: close Apr 21 15:36:37 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:36:37 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:36:37 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:36:37 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:36:37 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQqxxfn6YsezSe1GwgZo3rylgS0v7jps8BtN4DLw78TQ1Hh1z_-ev4wakoV_vfH6GhiPZncaWjJ4xZ036Q1BGwprYalwXnDUVp0TiciEGlFEP1PbEKOHu1Th6o7-csDT4hBn7rG0UPUPwVAsOIIbz9TW5mkc5gxvMsdw1zA1MwPxgfKk Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Project-Id: c6a34de8879c43bcb72b8eb70df45700 Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Project-Name: tempest-ServersNegativeTestJSON-1218199999 Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6a34de8879c43bcb72b8eb70df45700"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6a34de8879c43bcb72b8eb70df45700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c6a34de8879c43bcb72b8eb70df45700"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Tenant: tempest-ServersNegativeTestJSON-1218199999 Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Tenant-Id: c6a34de8879c43bcb72b8eb70df45700 Apr 21 15:36:37 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1218199999 Apr 21 15:36:37 user devstack@n-api.service[61512]: X-User: tempest-ServersNegativeTestJSON-1218199999-project-member Apr 21 15:36:37 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:36:37 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:36:37 user devstack@n-api.service[61512]: X-User-Id: a9c07c4b2ee5404db0ad5e5126dcdfb5 Apr 21 15:36:37 user devstack@n-api.service[61512]: X-User-Name: tempest-ServersNegativeTestJSON-1218199999-project-member Apr 21 15:36:37 user devstack@n-api.service[61512]: method: > Apr 21 15:36:37 user devstack@n-api.service[61512]: exception: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:36:37 user devstack@n-api.service[61512]: action_args: {'id': '77788e0b-c833-42c0-ba9b-3e32dce614f5'} Apr 21 15:36:37 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:36:37 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:36:37 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-d4a0091f-5e61-4b17-ac76-f20166c1d40d tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Returning 404 to user: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:36:37 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-d4a0091f-5e61-4b17-ac76-f20166c1d40d tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5" status: 404 len: 111 microversion: 2.1 time: 0.043398 Apr 21 15:36:37 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 66/200] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:36:37 2023] GET /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:36:37 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:37 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:37 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:36:37 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-abe6afff-539c-4c02-b297-9596377a8a2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:37 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-abe6afff-539c-4c02-b297-9596377a8a2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: e948aeec-acfe-4862-8f6a-28e02c05c46c] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-abe6afff-539c-4c02-b297-9596377a8a2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-abe6afff-539c-4c02-b297-9596377a8a2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-abe6afff-539c-4c02-b297-9596377a8a2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-abe6afff-539c-4c02-b297-9596377a8a2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-abe6afff-539c-4c02-b297-9596377a8a2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-abe6afff-539c-4c02-b297-9596377a8a2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:37 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-abe6afff-539c-4c02-b297-9596377a8a2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c07c4b2ee5404db0ad5e5126dcdfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a34de8879c43bcb72b8eb70df45700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:37 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-abe6afff-539c-4c02-b297-9596377a8a2c tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c" status: 200 len: 1493 microversion: 2.1 time: 0.237859 Apr 21 15:36:37 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 70/201] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:36:37 2023] GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c => generated 1493 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:36:38 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-4012235b-1ac6-4fe1-ab2e-e3f61515381a tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:38 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-4012235b-1ac6-4fe1-ab2e-e3f61515381a tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] [instance: 728b5fa0-caca-423d-a105-7789d7c242bd] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4012235b-1ac6-4fe1-ab2e-e3f61515381a tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4012235b-1ac6-4fe1-ab2e-e3f61515381a tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4012235b-1ac6-4fe1-ab2e-e3f61515381a tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4012235b-1ac6-4fe1-ab2e-e3f61515381a tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4012235b-1ac6-4fe1-ab2e-e3f61515381a tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4012235b-1ac6-4fe1-ab2e-e3f61515381a tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:39 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-4012235b-1ac6-4fe1-ab2e-e3f61515381a tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c901c0ffdf6e42f2a9c826aecb667d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4825737e417473f930a05f796980264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-4012235b-1ac6-4fe1-ab2e-e3f61515381a tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd" status: 200 len: 1671 microversion: 2.1 time: 0.218631 Apr 21 15:36:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 66/202] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:36:38 2023] GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd => generated 1671 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:36:40 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-df3453c0-b5ef-4037-b733-5ab77f19d1db tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '.version_select at 0x7f0c14652ef0>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:40 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-df3453c0-b5ef-4037-b733-5ab77f19d1db tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/fbb1260e-1b13-4c33-b43f-5bf52b0c31b9" status: 204 len: 0 microversion: 2.1 time: 0.185338 Apr 21 15:36:40 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 67/203] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:36:40 2023] DELETE /compute/v2.1/images/fbb1260e-1b13-4c33-b43f-5bf52b0c31b9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:36:40 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-69a4bf75-36a4-404c-a25a-b765f0c36fcd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:40 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-69a4bf75-36a4-404c-a25a-b765f0c36fcd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] [instance: 728b5fa0-caca-423d-a105-7789d7c242bd] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-69a4bf75-36a4-404c-a25a-b765f0c36fcd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-69a4bf75-36a4-404c-a25a-b765f0c36fcd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-69a4bf75-36a4-404c-a25a-b765f0c36fcd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-69a4bf75-36a4-404c-a25a-b765f0c36fcd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-69a4bf75-36a4-404c-a25a-b765f0c36fcd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-69a4bf75-36a4-404c-a25a-b765f0c36fcd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:40 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-69a4bf75-36a4-404c-a25a-b765f0c36fcd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] [instance: 728b5fa0-caca-423d-a105-7789d7c242bd] Going to try to terminate instance {{(pid=61511) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:36:40 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-69a4bf75-36a4-404c-a25a-b765f0c36fcd tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd" status: 204 len: 0 microversion: 2.1 time: 0.199655 Apr 21 15:36:40 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 71/204] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:36:40 2023] DELETE /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 21 15:36:40 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-2ec3ba71-86d0-4ce0-8674-ccd3862e07e0 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:40 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-2ec3ba71-86d0-4ce0-8674-ccd3862e07e0 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] [instance: 728b5fa0-caca-423d-a105-7789d7c242bd] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2ec3ba71-86d0-4ce0-8674-ccd3862e07e0 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2ec3ba71-86d0-4ce0-8674-ccd3862e07e0 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2ec3ba71-86d0-4ce0-8674-ccd3862e07e0 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2ec3ba71-86d0-4ce0-8674-ccd3862e07e0 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2ec3ba71-86d0-4ce0-8674-ccd3862e07e0 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-2ec3ba71-86d0-4ce0-8674-ccd3862e07e0 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:41 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-2ec3ba71-86d0-4ce0-8674-ccd3862e07e0 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c901c0ffdf6e42f2a9c826aecb667d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4825737e417473f930a05f796980264', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:41 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-2ec3ba71-86d0-4ce0-8674-ccd3862e07e0 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd" status: 200 len: 1677 microversion: 2.1 time: 0.172989 Apr 21 15:36:41 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 67/205] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:36:40 2023] GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:36:41 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-90ed5260-fbdd-49bf-8f17-90605f1899fa req-adf6be7d-3c71-478b-9c5c-bf605741196f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728b5fa0-caca-423d-a105-7789d7c242bd", "name": "network-vif-unplugged", "status": "completed", "tag": "b15324cd-b962-4849-85dc-175318b9011a"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:36:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-90ed5260-fbdd-49bf-8f17-90605f1899fa req-adf6be7d-3c71-478b-9c5c-bf605741196f service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-90ed5260-fbdd-49bf-8f17-90605f1899fa req-adf6be7d-3c71-478b-9c5c-bf605741196f service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-90ed5260-fbdd-49bf-8f17-90605f1899fa req-adf6be7d-3c71-478b-9c5c-bf605741196f service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:41 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-90ed5260-fbdd-49bf-8f17-90605f1899fa req-adf6be7d-3c71-478b-9c5c-bf605741196f service nova] Creating event network-vif-unplugged:b15324cd-b962-4849-85dc-175318b9011a for instance 728b5fa0-caca-423d-a105-7789d7c242bd on user Apr 21 15:36:41 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-90ed5260-fbdd-49bf-8f17-90605f1899fa req-adf6be7d-3c71-478b-9c5c-bf605741196f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027529 Apr 21 15:36:41 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 68/206] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:36:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:36:43 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-8aef5ebb-2d4f-480a-b489-04f4b813313f req-33216fb4-c5be-44b5-bc11-37204019ea3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728b5fa0-caca-423d-a105-7789d7c242bd", "name": "network-vif-plugged", "status": "completed", "tag": "b15324cd-b962-4849-85dc-175318b9011a"}, {"server_uuid": "728b5fa0-caca-423d-a105-7789d7c242bd", "name": "network-vif-deleted", "tag": "b15324cd-b962-4849-85dc-175318b9011a"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:36:43 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-8aef5ebb-2d4f-480a-b489-04f4b813313f req-33216fb4-c5be-44b5-bc11-37204019ea3b service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:43 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-8aef5ebb-2d4f-480a-b489-04f4b813313f req-33216fb4-c5be-44b5-bc11-37204019ea3b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:43 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-8aef5ebb-2d4f-480a-b489-04f4b813313f req-33216fb4-c5be-44b5-bc11-37204019ea3b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:43 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-8aef5ebb-2d4f-480a-b489-04f4b813313f req-33216fb4-c5be-44b5-bc11-37204019ea3b service nova] Creating event network-vif-plugged:b15324cd-b962-4849-85dc-175318b9011a for instance 728b5fa0-caca-423d-a105-7789d7c242bd on user Apr 21 15:36:43 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-8aef5ebb-2d4f-480a-b489-04f4b813313f req-33216fb4-c5be-44b5-bc11-37204019ea3b service nova] Creating event network-vif-deleted:b15324cd-b962-4849-85dc-175318b9011a for instance 728b5fa0-caca-423d-a105-7789d7c242bd on user Apr 21 15:36:43 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-8aef5ebb-2d4f-480a-b489-04f4b813313f req-33216fb4-c5be-44b5-bc11-37204019ea3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038743 Apr 21 15:36:43 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 72/207] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:36:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:36:47 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ddf2c198-7ef9-4fc1-874e-9db5e43b8979 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:47 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-ddf2c198-7ef9-4fc1-874e-9db5e43b8979 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] [instance: 39285a0d-d52f-43b4-a334-6793f7f749f4] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ddf2c198-7ef9-4fc1-874e-9db5e43b8979 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ddf2c198-7ef9-4fc1-874e-9db5e43b8979 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ddf2c198-7ef9-4fc1-874e-9db5e43b8979 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ddf2c198-7ef9-4fc1-874e-9db5e43b8979 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ddf2c198-7ef9-4fc1-874e-9db5e43b8979 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:47 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ddf2c198-7ef9-4fc1-874e-9db5e43b8979 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:47 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-ddf2c198-7ef9-4fc1-874e-9db5e43b8979 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] [instance: 39285a0d-d52f-43b4-a334-6793f7f749f4] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:36:47 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-ddf2c198-7ef9-4fc1-874e-9db5e43b8979 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/39285a0d-d52f-43b4-a334-6793f7f749f4" status: 204 len: 0 microversion: 2.1 time: 0.127092 Apr 21 15:36:47 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 68/208] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:36:47 2023] DELETE /compute/v2.1/servers/39285a0d-d52f-43b4-a334-6793f7f749f4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:36:47 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-10272eab-fed1-47bf-b7fc-1610d8f77d3e tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:47 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-10272eab-fed1-47bf-b7fc-1610d8f77d3e tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] [instance: 39285a0d-d52f-43b4-a334-6793f7f749f4] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-10272eab-fed1-47bf-b7fc-1610d8f77d3e tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-10272eab-fed1-47bf-b7fc-1610d8f77d3e tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-10272eab-fed1-47bf-b7fc-1610d8f77d3e tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-10272eab-fed1-47bf-b7fc-1610d8f77d3e tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-10272eab-fed1-47bf-b7fc-1610d8f77d3e tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:47 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-10272eab-fed1-47bf-b7fc-1610d8f77d3e tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:47 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-4fb8a826-5155-45b6-a2f8-fbe282df3001 req-64f21155-b50c-44ae-8e4a-539238e68788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39285a0d-d52f-43b4-a334-6793f7f749f4", "name": "network-vif-unplugged", "status": "completed", "tag": "d4ae87bd-e0df-465f-ba23-33e836eb17c9"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:36:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-4fb8a826-5155-45b6-a2f8-fbe282df3001 req-64f21155-b50c-44ae-8e4a-539238e68788 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-4fb8a826-5155-45b6-a2f8-fbe282df3001 req-64f21155-b50c-44ae-8e4a-539238e68788 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:47 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-4fb8a826-5155-45b6-a2f8-fbe282df3001 req-64f21155-b50c-44ae-8e4a-539238e68788 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:47 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-4fb8a826-5155-45b6-a2f8-fbe282df3001 req-64f21155-b50c-44ae-8e4a-539238e68788 service nova] Creating event network-vif-unplugged:d4ae87bd-e0df-465f-ba23-33e836eb17c9 for instance 39285a0d-d52f-43b4-a334-6793f7f749f4 on user Apr 21 15:36:47 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-4fb8a826-5155-45b6-a2f8-fbe282df3001 req-64f21155-b50c-44ae-8e4a-539238e68788 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040822 Apr 21 15:36:47 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 73/209] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:36:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:36:47 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-10272eab-fed1-47bf-b7fc-1610d8f77d3e tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '815d703557bc48b4b7bca89d62b8f66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d36e6b98eec4e29badb3a6c5d2c7bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:47 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-10272eab-fed1-47bf-b7fc-1610d8f77d3e tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39285a0d-d52f-43b4-a334-6793f7f749f4" status: 200 len: 1493 microversion: 2.1 time: 0.397786 Apr 21 15:36:47 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 69/210] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:36:47 2023] GET /compute/v2.1/servers/39285a0d-d52f-43b4-a334-6793f7f749f4 => generated 1493 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:36:49 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-86a12da9-f3a2-46ec-b44d-50c59c97efbc req-0af76796-e794-463e-a903-128418218170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39285a0d-d52f-43b4-a334-6793f7f749f4", "name": "network-vif-plugged", "status": "completed", "tag": "d4ae87bd-e0df-465f-ba23-33e836eb17c9"}, {"server_uuid": "39285a0d-d52f-43b4-a334-6793f7f749f4", "name": "network-vif-deleted", "tag": "d4ae87bd-e0df-465f-ba23-33e836eb17c9"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:36:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-86a12da9-f3a2-46ec-b44d-50c59c97efbc req-0af76796-e794-463e-a903-128418218170 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-86a12da9-f3a2-46ec-b44d-50c59c97efbc req-0af76796-e794-463e-a903-128418218170 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-86a12da9-f3a2-46ec-b44d-50c59c97efbc req-0af76796-e794-463e-a903-128418218170 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:49 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-86a12da9-f3a2-46ec-b44d-50c59c97efbc req-0af76796-e794-463e-a903-128418218170 service nova] Creating event network-vif-plugged:d4ae87bd-e0df-465f-ba23-33e836eb17c9 for instance 39285a0d-d52f-43b4-a334-6793f7f749f4 on user Apr 21 15:36:49 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-86a12da9-f3a2-46ec-b44d-50c59c97efbc req-0af76796-e794-463e-a903-128418218170 service nova] Creating event network-vif-deleted:d4ae87bd-e0df-465f-ba23-33e836eb17c9 for instance 39285a0d-d52f-43b4-a334-6793f7f749f4 on user Apr 21 15:36:49 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-86a12da9-f3a2-46ec-b44d-50c59c97efbc req-0af76796-e794-463e-a903-128418218170 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029861 Apr 21 15:36:49 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 69/211] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:36:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:36:50 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-e1e3cb7b-6035-455e-a0ba-de5a7eed47fe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:50 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-e1e3cb7b-6035-455e-a0ba-de5a7eed47fe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 662c333c-a6b4-4fec-90e5-3712fbebfc4d] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:50 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e1e3cb7b-6035-455e-a0ba-de5a7eed47fe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:50 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e1e3cb7b-6035-455e-a0ba-de5a7eed47fe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:50 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e1e3cb7b-6035-455e-a0ba-de5a7eed47fe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:50 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e1e3cb7b-6035-455e-a0ba-de5a7eed47fe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:50 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e1e3cb7b-6035-455e-a0ba-de5a7eed47fe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:50 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-e1e3cb7b-6035-455e-a0ba-de5a7eed47fe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:50 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-e1e3cb7b-6035-455e-a0ba-de5a7eed47fe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 662c333c-a6b4-4fec-90e5-3712fbebfc4d] Going to try to terminate instance {{(pid=61511) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:36:50 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-e1e3cb7b-6035-455e-a0ba-de5a7eed47fe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d" status: 204 len: 0 microversion: 2.1 time: 0.116597 Apr 21 15:36:50 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 74/212] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:36:50 2023] DELETE /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:36:50 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-4a1fb034-cc1f-435f-bb9d-88477c8915b2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:50 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-4a1fb034-cc1f-435f-bb9d-88477c8915b2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 662c333c-a6b4-4fec-90e5-3712fbebfc4d] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:50 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4a1fb034-cc1f-435f-bb9d-88477c8915b2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:50 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4a1fb034-cc1f-435f-bb9d-88477c8915b2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:50 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4a1fb034-cc1f-435f-bb9d-88477c8915b2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:50 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4a1fb034-cc1f-435f-bb9d-88477c8915b2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:50 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4a1fb034-cc1f-435f-bb9d-88477c8915b2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:50 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4a1fb034-cc1f-435f-bb9d-88477c8915b2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:51 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-4a1fb034-cc1f-435f-bb9d-88477c8915b2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e5168c1014774b77090a1eeb56abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9caeb7a6f3674392afae6edf987420fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:51 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-4a1fb034-cc1f-435f-bb9d-88477c8915b2 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d" status: 200 len: 1495 microversion: 2.1 time: 0.266463 Apr 21 15:36:51 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 70/213] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:36:50 2023] GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d => generated 1495 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:36:51 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-ba04cf7a-38c6-4fb7-8921-d8801dec5fe7 req-b84dd417-4932-499a-a2f2-c07cc601a61a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662c333c-a6b4-4fec-90e5-3712fbebfc4d", "name": "network-vif-unplugged", "status": "completed", "tag": "715a5a9e-5f15-4938-a3c5-c206f4b16794"}, {"server_uuid": "662c333c-a6b4-4fec-90e5-3712fbebfc4d", "name": "network-vif-plugged", "status": "completed", "tag": "715a5a9e-5f15-4938-a3c5-c206f4b16794"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:36:51 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-ba04cf7a-38c6-4fb7-8921-d8801dec5fe7 req-b84dd417-4932-499a-a2f2-c07cc601a61a service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:51 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-ba04cf7a-38c6-4fb7-8921-d8801dec5fe7 req-b84dd417-4932-499a-a2f2-c07cc601a61a service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:51 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-ba04cf7a-38c6-4fb7-8921-d8801dec5fe7 req-b84dd417-4932-499a-a2f2-c07cc601a61a service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:51 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-ba04cf7a-38c6-4fb7-8921-d8801dec5fe7 req-b84dd417-4932-499a-a2f2-c07cc601a61a service nova] Creating event network-vif-unplugged:715a5a9e-5f15-4938-a3c5-c206f4b16794 for instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d on user Apr 21 15:36:51 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-ba04cf7a-38c6-4fb7-8921-d8801dec5fe7 req-b84dd417-4932-499a-a2f2-c07cc601a61a service nova] Creating event network-vif-plugged:715a5a9e-5f15-4938-a3c5-c206f4b16794 for instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d on user Apr 21 15:36:51 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-ba04cf7a-38c6-4fb7-8921-d8801dec5fe7 req-b84dd417-4932-499a-a2f2-c07cc601a61a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031105 Apr 21 15:36:51 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 70/214] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:36:51 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:36:53 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-7dc8f71e-3395-4c4a-8472-97bd0ca4862f req-414cbfaf-4b8d-4664-9f9f-06e5a0d1c926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662c333c-a6b4-4fec-90e5-3712fbebfc4d", "name": "network-vif-deleted", "tag": "715a5a9e-5f15-4938-a3c5-c206f4b16794"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:36:53 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-7dc8f71e-3395-4c4a-8472-97bd0ca4862f req-414cbfaf-4b8d-4664-9f9f-06e5a0d1c926 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:53 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-7dc8f71e-3395-4c4a-8472-97bd0ca4862f req-414cbfaf-4b8d-4664-9f9f-06e5a0d1c926 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:53 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-7dc8f71e-3395-4c4a-8472-97bd0ca4862f req-414cbfaf-4b8d-4664-9f9f-06e5a0d1c926 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:53 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-7dc8f71e-3395-4c4a-8472-97bd0ca4862f req-414cbfaf-4b8d-4664-9f9f-06e5a0d1c926 service nova] Creating event network-vif-deleted:715a5a9e-5f15-4938-a3c5-c206f4b16794 for instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d on user Apr 21 15:36:53 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-7dc8f71e-3395-4c4a-8472-97bd0ca4862f req-414cbfaf-4b8d-4664-9f9f-06e5a0d1c926 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032724 Apr 21 15:36:53 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 75/215] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:36:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:36:55 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-e7b102c1-e6d3-4daf-b3c8-d31a3b065f06 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:55 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-e7b102c1-e6d3-4daf-b3c8-d31a3b065f06 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: a2d2b868-5cc3-4349-850e-0246b1836705] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-e7b102c1-e6d3-4daf-b3c8-d31a3b065f06 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-e7b102c1-e6d3-4daf-b3c8-d31a3b065f06 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-e7b102c1-e6d3-4daf-b3c8-d31a3b065f06 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-e7b102c1-e6d3-4daf-b3c8-d31a3b065f06 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-e7b102c1-e6d3-4daf-b3c8-d31a3b065f06 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-e7b102c1-e6d3-4daf-b3c8-d31a3b065f06 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:56 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-e7b102c1-e6d3-4daf-b3c8-d31a3b065f06 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:56 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-e7b102c1-e6d3-4daf-b3c8-d31a3b065f06 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:56 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-e7b102c1-e6d3-4daf-b3c8-d31a3b065f06 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:36:56 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-e7b102c1-e6d3-4daf-b3c8-d31a3b065f06 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705" status: 200 len: 1691 microversion: 2.87 time: 0.485240 Apr 21 15:36:56 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 71/216] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:36:55 2023] GET /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705 => generated 1691 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:36:58 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-3f5b4d91-ec41-4843-8bd5-792c67247ed2 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:58 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-3f5b4d91-ec41-4843-8bd5-792c67247ed2 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 4861f0f0-4b0b-485b-888b-f876d6136a0e] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3f5b4d91-ec41-4843-8bd5-792c67247ed2 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3f5b4d91-ec41-4843-8bd5-792c67247ed2 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3f5b4d91-ec41-4843-8bd5-792c67247ed2 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3f5b4d91-ec41-4843-8bd5-792c67247ed2 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3f5b4d91-ec41-4843-8bd5-792c67247ed2 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3f5b4d91-ec41-4843-8bd5-792c67247ed2 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-3f5b4d91-ec41-4843-8bd5-792c67247ed2 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.214173 Apr 21 15:36:58 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 71/217] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 15:36:58 2023] GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e/os-interface => generated 282 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:36:59 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-8f26038c-bd4f-402c-af78-91ad3ac34cd8 req-7154a8f5-43c6-420a-878c-36f87d474206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4861f0f0-4b0b-485b-888b-f876d6136a0e", "tag": "771917d1-f8bf-43be-baf5-a82873b18a73"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:36:59 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-8f26038c-bd4f-402c-af78-91ad3ac34cd8 req-7154a8f5-43c6-420a-878c-36f87d474206 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:59 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-8f26038c-bd4f-402c-af78-91ad3ac34cd8 req-7154a8f5-43c6-420a-878c-36f87d474206 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:59 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-8f26038c-bd4f-402c-af78-91ad3ac34cd8 req-7154a8f5-43c6-420a-878c-36f87d474206 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:59 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-8f26038c-bd4f-402c-af78-91ad3ac34cd8 req-7154a8f5-43c6-420a-878c-36f87d474206 service nova] Creating event network-changed:771917d1-f8bf-43be-baf5-a82873b18a73 for instance 4861f0f0-4b0b-485b-888b-f876d6136a0e on user Apr 21 15:36:59 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-8f26038c-bd4f-402c-af78-91ad3ac34cd8 req-7154a8f5-43c6-420a-878c-36f87d474206 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030872 Apr 21 15:36:59 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 76/218] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:36:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 15:36:59 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-1692e3e1-3c92-405b-8596-6d3490bbaedd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:36:59 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-1692e3e1-3c92-405b-8596-6d3490bbaedd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 4861f0f0-4b0b-485b-888b-f876d6136a0e] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:36:59 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1692e3e1-3c92-405b-8596-6d3490bbaedd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:59 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1692e3e1-3c92-405b-8596-6d3490bbaedd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:59 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1692e3e1-3c92-405b-8596-6d3490bbaedd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:59 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1692e3e1-3c92-405b-8596-6d3490bbaedd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:36:59 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1692e3e1-3c92-405b-8596-6d3490bbaedd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:36:59 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1692e3e1-3c92-405b-8596-6d3490bbaedd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:36:59 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-1692e3e1-3c92-405b-8596-6d3490bbaedd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e/ips" status: 200 len: 108 microversion: 2.1 time: 0.046921 Apr 21 15:36:59 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 72/219] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 15:36:59 2023] GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e/ips => generated 108 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:01 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c06087a0-f468-46d4-b1a3-a68c75cbc293 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:01 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c06087a0-f468-46d4-b1a3-a68c75cbc293 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 4861f0f0-4b0b-485b-888b-f876d6136a0e] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c06087a0-f468-46d4-b1a3-a68c75cbc293 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c06087a0-f468-46d4-b1a3-a68c75cbc293 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c06087a0-f468-46d4-b1a3-a68c75cbc293 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c06087a0-f468-46d4-b1a3-a68c75cbc293 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c06087a0-f468-46d4-b1a3-a68c75cbc293 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:01 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c06087a0-f468-46d4-b1a3-a68c75cbc293 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:01 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c06087a0-f468-46d4-b1a3-a68c75cbc293 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 4861f0f0-4b0b-485b-888b-f876d6136a0e] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:37:01 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c06087a0-f468-46d4-b1a3-a68c75cbc293 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e" status: 204 len: 0 microversion: 2.1 time: 0.135566 Apr 21 15:37:01 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 72/220] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:37:01 2023] DELETE /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:37:01 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-1fb3b751-c9e5-4474-8d9b-d1a1c3063625 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:01 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-1fb3b751-c9e5-4474-8d9b-d1a1c3063625 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 4861f0f0-4b0b-485b-888b-f876d6136a0e] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-1fb3b751-c9e5-4474-8d9b-d1a1c3063625 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-1fb3b751-c9e5-4474-8d9b-d1a1c3063625 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-1fb3b751-c9e5-4474-8d9b-d1a1c3063625 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-1fb3b751-c9e5-4474-8d9b-d1a1c3063625 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-1fb3b751-c9e5-4474-8d9b-d1a1c3063625 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-1fb3b751-c9e5-4474-8d9b-d1a1c3063625 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:01 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-4e2283a0-17d8-4c62-83ac-0dc4990c5269 req-7a6beb8c-83a4-41dc-a152-f21688f8a84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4861f0f0-4b0b-485b-888b-f876d6136a0e", "name": "network-vif-unplugged", "status": "completed", "tag": "771917d1-f8bf-43be-baf5-a82873b18a73"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:01 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-4e2283a0-17d8-4c62-83ac-0dc4990c5269 req-7a6beb8c-83a4-41dc-a152-f21688f8a84f service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:01 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-4e2283a0-17d8-4c62-83ac-0dc4990c5269 req-7a6beb8c-83a4-41dc-a152-f21688f8a84f service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:01 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-4e2283a0-17d8-4c62-83ac-0dc4990c5269 req-7a6beb8c-83a4-41dc-a152-f21688f8a84f service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:01 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-4e2283a0-17d8-4c62-83ac-0dc4990c5269 req-7a6beb8c-83a4-41dc-a152-f21688f8a84f service nova] Creating event network-vif-unplugged:771917d1-f8bf-43be-baf5-a82873b18a73 for instance 4861f0f0-4b0b-485b-888b-f876d6136a0e on user Apr 21 15:37:01 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-4e2283a0-17d8-4c62-83ac-0dc4990c5269 req-7a6beb8c-83a4-41dc-a152-f21688f8a84f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034535 Apr 21 15:37:01 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 73/221] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:01 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-1fb3b751-c9e5-4474-8d9b-d1a1c3063625 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b6dad090b84d0d9b0a8c3f6421a4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de04c4cc5f140c08c23e34065a9b59a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:37:01 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-1fb3b751-c9e5-4474-8d9b-d1a1c3063625 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e" status: 200 len: 1669 microversion: 2.1 time: 0.316247 Apr 21 15:37:01 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 77/222] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:37:01 2023] GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e => generated 1669 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:37:02 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-5cf52544-6d9d-4be4-a83d-3602ce0fd164 req-67d5c6ff-af68-47c1-adc4-d77c41a14a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4861f0f0-4b0b-485b-888b-f876d6136a0e", "name": "network-vif-deleted", "tag": "771917d1-f8bf-43be-baf5-a82873b18a73"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:02 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-5cf52544-6d9d-4be4-a83d-3602ce0fd164 req-67d5c6ff-af68-47c1-adc4-d77c41a14a5b service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:02 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-5cf52544-6d9d-4be4-a83d-3602ce0fd164 req-67d5c6ff-af68-47c1-adc4-d77c41a14a5b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:02 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-5cf52544-6d9d-4be4-a83d-3602ce0fd164 req-67d5c6ff-af68-47c1-adc4-d77c41a14a5b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:02 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-5cf52544-6d9d-4be4-a83d-3602ce0fd164 req-67d5c6ff-af68-47c1-adc4-d77c41a14a5b service nova] Creating event network-vif-deleted:771917d1-f8bf-43be-baf5-a82873b18a73 for instance 4861f0f0-4b0b-485b-888b-f876d6136a0e on user Apr 21 15:37:02 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-5cf52544-6d9d-4be4-a83d-3602ce0fd164 req-67d5c6ff-af68-47c1-adc4-d77c41a14a5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042298 Apr 21 15:37:02 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 73/223] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:03 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-bf670cad-0013-457e-b096-2ce321a3bed9 req-a9097f75-b052-48e7-bf2f-4363259df63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4861f0f0-4b0b-485b-888b-f876d6136a0e", "name": "network-vif-plugged", "status": "completed", "tag": "771917d1-f8bf-43be-baf5-a82873b18a73"}, {"server_uuid": "4861f0f0-4b0b-485b-888b-f876d6136a0e", "name": "network-vif-plugged", "status": "completed", "tag": "771917d1-f8bf-43be-baf5-a82873b18a73"}, {"server_uuid": "4861f0f0-4b0b-485b-888b-f876d6136a0e", "name": "network-vif-plugged", "status": "completed", "tag": "771917d1-f8bf-43be-baf5-a82873b18a73"}, {"server_uuid": "4861f0f0-4b0b-485b-888b-f876d6136a0e", "name": "network-vif-unplugged", "status": "completed", "tag": "771917d1-f8bf-43be-baf5-a82873b18a73"}, {"server_uuid": "4861f0f0-4b0b-485b-888b-f876d6136a0e", "name": "network-vif-plugged", "status": "completed", "tag": "771917d1-f8bf-43be-baf5-a82873b18a73"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:03 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-bf670cad-0013-457e-b096-2ce321a3bed9 req-a9097f75-b052-48e7-bf2f-4363259df63d service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:03 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-bf670cad-0013-457e-b096-2ce321a3bed9 req-a9097f75-b052-48e7-bf2f-4363259df63d service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:03 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-bf670cad-0013-457e-b096-2ce321a3bed9 req-a9097f75-b052-48e7-bf2f-4363259df63d service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:03 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-bf670cad-0013-457e-b096-2ce321a3bed9 req-a9097f75-b052-48e7-bf2f-4363259df63d service nova] Creating event network-vif-plugged:771917d1-f8bf-43be-baf5-a82873b18a73 for instance 4861f0f0-4b0b-485b-888b-f876d6136a0e on user Apr 21 15:37:03 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-bf670cad-0013-457e-b096-2ce321a3bed9 req-a9097f75-b052-48e7-bf2f-4363259df63d service nova] Creating event network-vif-plugged:771917d1-f8bf-43be-baf5-a82873b18a73 for instance 4861f0f0-4b0b-485b-888b-f876d6136a0e on user Apr 21 15:37:03 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-bf670cad-0013-457e-b096-2ce321a3bed9 req-a9097f75-b052-48e7-bf2f-4363259df63d service nova] Creating event network-vif-plugged:771917d1-f8bf-43be-baf5-a82873b18a73 for instance 4861f0f0-4b0b-485b-888b-f876d6136a0e on user Apr 21 15:37:03 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-bf670cad-0013-457e-b096-2ce321a3bed9 req-a9097f75-b052-48e7-bf2f-4363259df63d service nova] Creating event network-vif-unplugged:771917d1-f8bf-43be-baf5-a82873b18a73 for instance 4861f0f0-4b0b-485b-888b-f876d6136a0e on user Apr 21 15:37:03 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-bf670cad-0013-457e-b096-2ce321a3bed9 req-a9097f75-b052-48e7-bf2f-4363259df63d service nova] Creating event network-vif-plugged:771917d1-f8bf-43be-baf5-a82873b18a73 for instance 4861f0f0-4b0b-485b-888b-f876d6136a0e on user Apr 21 15:37:03 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-bf670cad-0013-457e-b096-2ce321a3bed9 req-a9097f75-b052-48e7-bf2f-4363259df63d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034804 Apr 21 15:37:03 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 74/224] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:03 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:05 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-f2396c6b-d578-4b73-832d-59a983541249 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:05 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-f2396c6b-d578-4b73-832d-59a983541249 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f2396c6b-d578-4b73-832d-59a983541249 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f2396c6b-d578-4b73-832d-59a983541249 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f2396c6b-d578-4b73-832d-59a983541249 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f2396c6b-d578-4b73-832d-59a983541249 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f2396c6b-d578-4b73-832d-59a983541249 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f2396c6b-d578-4b73-832d-59a983541249 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:05 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-f2396c6b-d578-4b73-832d-59a983541249 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:37:05 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-f2396c6b-d578-4b73-832d-59a983541249 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1657 microversion: 2.1 time: 0.229171 Apr 21 15:37:05 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 78/225] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:37:05 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1657 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:37:31 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:37:31 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:37:31 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-1d533228-57af-4bc5-846d-d1077fe8588d tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:31 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-1d533228-57af-4bc5-846d-d1077fe8588d tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] [instance: 728b5fa0-caca-423d-a105-7789d7c242bd] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:31 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1d533228-57af-4bc5-846d-d1077fe8588d tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:31 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1d533228-57af-4bc5-846d-d1077fe8588d tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:31 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1d533228-57af-4bc5-846d-d1077fe8588d tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:31 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1d533228-57af-4bc5-846d-d1077fe8588d tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:31 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1d533228-57af-4bc5-846d-d1077fe8588d tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:31 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1d533228-57af-4bc5-846d-d1077fe8588d tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:31 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-1d533228-57af-4bc5-846d-d1077fe8588d tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] HTTP exception thrown: Instance 728b5fa0-caca-423d-a105-7789d7c242bd could not be found. Apr 21 15:37:31 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-1d533228-57af-4bc5-846d-d1077fe8588d tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Request method failure captured: Apr 21 15:37:31 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd HTTP/1.1 Apr 21 15:37:31 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:37:31 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:37:31 user devstack@n-api.service[61510]: Connection: close Apr 21 15:37:31 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:37:31 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:37:31 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:37:31 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:37:31 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqykbYegaoLfmdMJbqzz2j2igSn6dAOMxdoCCByu_OBs0uo58x1-FnovwRwlFaV1PK-bBFXEBwcSi2GeJkmyTkPajcOhtP2J_gqQypayM0x6Ue1I5AXQtVIyTynMRaWEEYn8U6cY5MICEguJ1x5UTdWa19G--pD6gzGSWMKv1QIU1Yc Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Project-Id: b4825737e417473f930a05f796980264 Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Project-Name: tempest-ServerStableDeviceRescueTest-281496225 Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4825737e417473f930a05f796980264"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b4825737e417473f930a05f796980264"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b4825737e417473f930a05f796980264"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Tenant: tempest-ServerStableDeviceRescueTest-281496225 Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Tenant-Id: b4825737e417473f930a05f796980264 Apr 21 15:37:31 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-281496225 Apr 21 15:37:31 user devstack@n-api.service[61510]: X-User: tempest-ServerStableDeviceRescueTest-281496225-project-member Apr 21 15:37:31 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:37:31 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:37:31 user devstack@n-api.service[61510]: X-User-Id: c901c0ffdf6e42f2a9c826aecb667d89 Apr 21 15:37:31 user devstack@n-api.service[61510]: X-User-Name: tempest-ServerStableDeviceRescueTest-281496225-project-member Apr 21 15:37:31 user devstack@n-api.service[61510]: method: > Apr 21 15:37:31 user devstack@n-api.service[61510]: exception: Instance 728b5fa0-caca-423d-a105-7789d7c242bd could not be found. Apr 21 15:37:31 user devstack@n-api.service[61510]: action_args: {'id': '728b5fa0-caca-423d-a105-7789d7c242bd'} Apr 21 15:37:31 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728b5fa0-caca-423d-a105-7789d7c242bd could not be found. Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728b5fa0-caca-423d-a105-7789d7c242bd could not be found. Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728b5fa0-caca-423d-a105-7789d7c242bd could not be found. Apr 21 15:37:31 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:31 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-1d533228-57af-4bc5-846d-d1077fe8588d tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Returning 404 to user: Instance 728b5fa0-caca-423d-a105-7789d7c242bd could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:37:31 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-1d533228-57af-4bc5-846d-d1077fe8588d tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd" status: 404 len: 111 microversion: 2.1 time: 0.043029 Apr 21 15:37:31 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 74/226] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:37:31 2023] GET /compute/v2.1/servers/728b5fa0-caca-423d-a105-7789d7c242bd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:37:31 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=18 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:37:31 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=30 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:37:31 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-2958167c-18c6-4939-a53e-3d3f22909825 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] Calling method '.version_select at 0x7f0c14651870>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:31 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-2958167c-18c6-4939-a53e-3d3f22909825 tempest-ServerStableDeviceRescueTest-281496225 tempest-ServerStableDeviceRescueTest-281496225-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-257006120" status: 202 len: 0 microversion: 2.1 time: 0.035720 Apr 21 15:37:31 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 75/227] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 15:37:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-257006120 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:37:37 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-3a93089a-3904-4def-932c-76cba238ced8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:37 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-3a93089a-3904-4def-932c-76cba238ced8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 1570e80b-42fe-48de-a976-f821fdab5f9b] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:37 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:37:37 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:37:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3a93089a-3904-4def-932c-76cba238ced8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3a93089a-3904-4def-932c-76cba238ced8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3a93089a-3904-4def-932c-76cba238ced8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3a93089a-3904-4def-932c-76cba238ced8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3a93089a-3904-4def-932c-76cba238ced8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3a93089a-3904-4def-932c-76cba238ced8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:37 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-3a93089a-3904-4def-932c-76cba238ced8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.278484 Apr 21 15:37:37 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 79/228] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 15:37:37 2023] GET /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b/os-interface => generated 282 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-1dd68f08-970c-4046-9c6f-3c21792fa994 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:37 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-1dd68f08-970c-4046-9c6f-3c21792fa994 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] [instance: 39285a0d-d52f-43b4-a334-6793f7f749f4] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1dd68f08-970c-4046-9c6f-3c21792fa994 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1dd68f08-970c-4046-9c6f-3c21792fa994 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1dd68f08-970c-4046-9c6f-3c21792fa994 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1dd68f08-970c-4046-9c6f-3c21792fa994 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1dd68f08-970c-4046-9c6f-3c21792fa994 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-1dd68f08-970c-4046-9c6f-3c21792fa994 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-1dd68f08-970c-4046-9c6f-3c21792fa994 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] HTTP exception thrown: Instance 39285a0d-d52f-43b4-a334-6793f7f749f4 could not be found. Apr 21 15:37:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-1dd68f08-970c-4046-9c6f-3c21792fa994 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Request method failure captured: Apr 21 15:37:37 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/39285a0d-d52f-43b4-a334-6793f7f749f4 HTTP/1.1 Apr 21 15:37:37 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:37:37 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:37:37 user devstack@n-api.service[61510]: Connection: close Apr 21 15:37:37 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:37:37 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:37:37 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:37:37 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:37:37 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQq0cTV6WMAfd94SPZ0sVXpwMmobrNZLLa8PlH5Pvn9r5osWD4R3obIRxakHdADJGWFNtS7VkniLQILTnpL-M1Uw47co2w9FUUAnhn687-z4oLcDKOBlZCMX44f1ZMn6gkuRV05-4Go3Ix92d63qe025vOmVpSIrV34iz5ZF2ukLf7Aw Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Project-Id: 9d36e6b98eec4e29badb3a6c5d2c7bc7 Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Project-Name: tempest-VolumesActionsTest-1097941623 Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d36e6b98eec4e29badb3a6c5d2c7bc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d36e6b98eec4e29badb3a6c5d2c7bc7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9d36e6b98eec4e29badb3a6c5d2c7bc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Tenant: tempest-VolumesActionsTest-1097941623 Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Tenant-Id: 9d36e6b98eec4e29badb3a6c5d2c7bc7 Apr 21 15:37:37 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-VolumesActionsTest-1097941623 Apr 21 15:37:37 user devstack@n-api.service[61510]: X-User: tempest-VolumesActionsTest-1097941623-project-member Apr 21 15:37:37 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:37:37 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:37:37 user devstack@n-api.service[61510]: X-User-Id: 815d703557bc48b4b7bca89d62b8f66f Apr 21 15:37:37 user devstack@n-api.service[61510]: X-User-Name: tempest-VolumesActionsTest-1097941623-project-member Apr 21 15:37:37 user devstack@n-api.service[61510]: method: > Apr 21 15:37:37 user devstack@n-api.service[61510]: exception: Instance 39285a0d-d52f-43b4-a334-6793f7f749f4 could not be found. Apr 21 15:37:37 user devstack@n-api.service[61510]: action_args: {'id': '39285a0d-d52f-43b4-a334-6793f7f749f4'} Apr 21 15:37:37 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39285a0d-d52f-43b4-a334-6793f7f749f4 could not be found. Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39285a0d-d52f-43b4-a334-6793f7f749f4 could not be found. Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39285a0d-d52f-43b4-a334-6793f7f749f4 could not be found. Apr 21 15:37:37 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-1dd68f08-970c-4046-9c6f-3c21792fa994 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] Returning 404 to user: Instance 39285a0d-d52f-43b4-a334-6793f7f749f4 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:37:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-1dd68f08-970c-4046-9c6f-3c21792fa994 tempest-VolumesActionsTest-1097941623 tempest-VolumesActionsTest-1097941623-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39285a0d-d52f-43b4-a334-6793f7f749f4" status: 404 len: 111 microversion: 2.1 time: 0.031514 Apr 21 15:37:37 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 75/229] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:37:37 2023] GET /compute/v2.1/servers/39285a0d-d52f-43b4-a334-6793f7f749f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:37:38 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-b00b8861-e92a-4217-859f-a73ff75f0399 req-57b17d26-b9fe-4fe2-803b-74a219d16186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1570e80b-42fe-48de-a976-f821fdab5f9b", "tag": "606f098b-357f-46e2-b2fc-5be513fb6b35"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:38 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-b00b8861-e92a-4217-859f-a73ff75f0399 req-57b17d26-b9fe-4fe2-803b-74a219d16186 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:38 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-b00b8861-e92a-4217-859f-a73ff75f0399 req-57b17d26-b9fe-4fe2-803b-74a219d16186 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:38 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-b00b8861-e92a-4217-859f-a73ff75f0399 req-57b17d26-b9fe-4fe2-803b-74a219d16186 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:38 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-b00b8861-e92a-4217-859f-a73ff75f0399 req-57b17d26-b9fe-4fe2-803b-74a219d16186 service nova] Creating event network-changed:606f098b-357f-46e2-b2fc-5be513fb6b35 for instance 1570e80b-42fe-48de-a976-f821fdab5f9b on user Apr 21 15:37:38 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-b00b8861-e92a-4217-859f-a73ff75f0399 req-57b17d26-b9fe-4fe2-803b-74a219d16186 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176740 Apr 21 15:37:38 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 76/230] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:39 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1601431215", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "networks": [{"uuid": "4a3a11bc-176c-4ff5-ab17-33bb5d0c9b96"}]}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:39 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] validate_networks() for [('4a3a11bc-176c-4ff5-ab17-33bb5d0c9b96', None, None, None, None, None)] {{(pid=61511) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:37:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b7acfb43-a252-45ed-a030-60c77ee94de9 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:39 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-b7acfb43-a252-45ed-a030-60c77ee94de9 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: e948aeec-acfe-4862-8f6a-28e02c05c46c] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b7acfb43-a252-45ed-a030-60c77ee94de9 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b7acfb43-a252-45ed-a030-60c77ee94de9 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b7acfb43-a252-45ed-a030-60c77ee94de9 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b7acfb43-a252-45ed-a030-60c77ee94de9 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b7acfb43-a252-45ed-a030-60c77ee94de9 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b7acfb43-a252-45ed-a030-60c77ee94de9 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:39 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-b7acfb43-a252-45ed-a030-60c77ee94de9 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c07c4b2ee5404db0ad5e5126dcdfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a34de8879c43bcb72b8eb70df45700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:37:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b7acfb43-a252-45ed-a030-60c77ee94de9 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c" status: 200 len: 1493 microversion: 2.1 time: 0.218618 Apr 21 15:37:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 76/231] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:37:39 2023] GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c => generated 1493 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Flavor limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Image limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Flavor pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Image pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Getting quotas for project 78462ef768874f1e96974e457bcb0198. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Getting quotas for user 125905d0824740b98235b346068bdb97 and project 78462ef768874f1e96974e457bcb0198. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Going to run 1 instances... {{(pid=61511) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:37:40 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 6235b26b-a923-41f1-9cf6-d8761ee099d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:37:40 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-ed29ec89-7a31-4b64-abad-d0bd0c517ffc tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.029207 Apr 21 15:37:40 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 80/232] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:37:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:37:40 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-47eb1359-c141-42cc-ad2e-0b9e34bb83b2 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:40 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-47eb1359-c141-42cc-ad2e-0b9e34bb83b2 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 6235b26b-a923-41f1-9cf6-d8761ee099d5] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:40 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-47eb1359-c141-42cc-ad2e-0b9e34bb83b2 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125905d0824740b98235b346068bdb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78462ef768874f1e96974e457bcb0198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:37:40 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-47eb1359-c141-42cc-ad2e-0b9e34bb83b2 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6235b26b-a923-41f1-9cf6-d8761ee099d5" status: 200 len: 1212 microversion: 2.1 time: 0.086039 Apr 21 15:37:40 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 77/233] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:37:40 2023] GET /compute/v2.1/servers/6235b26b-a923-41f1-9cf6-d8761ee099d5 => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:37:41 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6617aed5-fc3e-42ab-9eaf-062b5fc71a0d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:41 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-6617aed5-fc3e-42ab-9eaf-062b5fc71a0d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 662c333c-a6b4-4fec-90e5-3712fbebfc4d] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6617aed5-fc3e-42ab-9eaf-062b5fc71a0d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6617aed5-fc3e-42ab-9eaf-062b5fc71a0d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6617aed5-fc3e-42ab-9eaf-062b5fc71a0d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6617aed5-fc3e-42ab-9eaf-062b5fc71a0d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6617aed5-fc3e-42ab-9eaf-062b5fc71a0d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6617aed5-fc3e-42ab-9eaf-062b5fc71a0d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:41 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-6617aed5-fc3e-42ab-9eaf-062b5fc71a0d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] HTTP exception thrown: Instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d could not be found. Apr 21 15:37:41 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6617aed5-fc3e-42ab-9eaf-062b5fc71a0d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Request method failure captured: Apr 21 15:37:41 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d HTTP/1.1 Apr 21 15:37:41 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:37:41 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:37:41 user devstack@n-api.service[61510]: Connection: close Apr 21 15:37:41 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:37:41 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:37:41 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:37:41 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:37:41 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqxx1kpWNXw6tUaa6IWpAywwnckUN9YHznHVP1IMrVHAKQmJaHCMRUWMlscIfgpVmPy-xHDqSAjkcvlNmQyPRdxwqIylXxxC-nEsNV77EnIc8KZc62wLcCmDqT4dl19nes5yY4yD5XJJCpevQ6nWfdJPn3CgEedBTufR6LoRsb87tbc Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Project-Id: 9caeb7a6f3674392afae6edf987420fa Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2010293687 Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9caeb7a6f3674392afae6edf987420fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9caeb7a6f3674392afae6edf987420fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9caeb7a6f3674392afae6edf987420fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2010293687 Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Tenant-Id: 9caeb7a6f3674392afae6edf987420fa Apr 21 15:37:41 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2010293687 Apr 21 15:37:41 user devstack@n-api.service[61510]: X-User: tempest-ServerRescueNegativeTestJSON-2010293687-project-member Apr 21 15:37:41 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:37:41 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:37:41 user devstack@n-api.service[61510]: X-User-Id: fc4e5168c1014774b77090a1eeb56abf Apr 21 15:37:41 user devstack@n-api.service[61510]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2010293687-project-member Apr 21 15:37:41 user devstack@n-api.service[61510]: method: > Apr 21 15:37:41 user devstack@n-api.service[61510]: exception: Instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d could not be found. Apr 21 15:37:41 user devstack@n-api.service[61510]: action_args: {'id': '662c333c-a6b4-4fec-90e5-3712fbebfc4d'} Apr 21 15:37:41 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d could not be found. Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d could not be found. Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d could not be found. Apr 21 15:37:41 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:37:41 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6617aed5-fc3e-42ab-9eaf-062b5fc71a0d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Returning 404 to user: Instance 662c333c-a6b4-4fec-90e5-3712fbebfc4d could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:37:41 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-6617aed5-fc3e-42ab-9eaf-062b5fc71a0d tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d" status: 404 len: 111 microversion: 2.1 time: 0.169319 Apr 21 15:37:41 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 77/234] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:37:41 2023] GET /compute/v2.1/servers/662c333c-a6b4-4fec-90e5-3712fbebfc4d => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:37:41 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-dcd2534c-5134-448d-a140-de91e5accffe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:41 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-dcd2534c-5134-448d-a140-de91e5accffe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 2da62263-7d42-447d-abee-597a75abb16f] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dcd2534c-5134-448d-a140-de91e5accffe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dcd2534c-5134-448d-a140-de91e5accffe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dcd2534c-5134-448d-a140-de91e5accffe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dcd2534c-5134-448d-a140-de91e5accffe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dcd2534c-5134-448d-a140-de91e5accffe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dcd2534c-5134-448d-a140-de91e5accffe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:41 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-dcd2534c-5134-448d-a140-de91e5accffe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 2da62263-7d42-447d-abee-597a75abb16f] Going to try to terminate instance {{(pid=61511) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:37:41 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-dcd2534c-5134-448d-a140-de91e5accffe tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2da62263-7d42-447d-abee-597a75abb16f" status: 204 len: 0 microversion: 2.1 time: 0.180491 Apr 21 15:37:41 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 81/235] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:37:41 2023] DELETE /compute/v2.1/servers/2da62263-7d42-447d-abee-597a75abb16f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 21 15:37:41 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-9c80e802-0bed-4e7c-bd4c-d20fbb4c5a71 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:41 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-9c80e802-0bed-4e7c-bd4c-d20fbb4c5a71 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 2da62263-7d42-447d-abee-597a75abb16f] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-9c80e802-0bed-4e7c-bd4c-d20fbb4c5a71 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-9c80e802-0bed-4e7c-bd4c-d20fbb4c5a71 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-9c80e802-0bed-4e7c-bd4c-d20fbb4c5a71 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-9c80e802-0bed-4e7c-bd4c-d20fbb4c5a71 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-9c80e802-0bed-4e7c-bd4c-d20fbb4c5a71 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-9c80e802-0bed-4e7c-bd4c-d20fbb4c5a71 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:41 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-9c80e802-0bed-4e7c-bd4c-d20fbb4c5a71 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e5168c1014774b77090a1eeb56abf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9caeb7a6f3674392afae6edf987420fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:37:41 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-9c80e802-0bed-4e7c-bd4c-d20fbb4c5a71 tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2da62263-7d42-447d-abee-597a75abb16f" status: 200 len: 1509 microversion: 2.1 time: 0.253910 Apr 21 15:37:41 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 78/236] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:37:41 2023] GET /compute/v2.1/servers/2da62263-7d42-447d-abee-597a75abb16f => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:37:42 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-d885261e-c6c3-44db-9862-9c43a9a1add1 req-3fa433e2-1edb-40f6-9b9c-cd10a09fd10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da62263-7d42-447d-abee-597a75abb16f", "name": "network-vif-unplugged", "status": "completed", "tag": "37a7d258-7421-45a2-a4ba-5efa8c64120d"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d885261e-c6c3-44db-9862-9c43a9a1add1 req-3fa433e2-1edb-40f6-9b9c-cd10a09fd10b service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d885261e-c6c3-44db-9862-9c43a9a1add1 req-3fa433e2-1edb-40f6-9b9c-cd10a09fd10b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d885261e-c6c3-44db-9862-9c43a9a1add1 req-3fa433e2-1edb-40f6-9b9c-cd10a09fd10b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:42 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-d885261e-c6c3-44db-9862-9c43a9a1add1 req-3fa433e2-1edb-40f6-9b9c-cd10a09fd10b service nova] Creating event network-vif-unplugged:37a7d258-7421-45a2-a4ba-5efa8c64120d for instance 2da62263-7d42-447d-abee-597a75abb16f on user Apr 21 15:37:42 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-d885261e-c6c3-44db-9862-9c43a9a1add1 req-3fa433e2-1edb-40f6-9b9c-cd10a09fd10b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089363 Apr 21 15:37:42 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 78/237] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:43 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-9face24b-08c3-4cf4-95bd-27a9b95bb643 req-8038c4fe-6b90-4264-91da-9269cab6db5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da62263-7d42-447d-abee-597a75abb16f", "name": "network-vif-deleted", "tag": "37a7d258-7421-45a2-a4ba-5efa8c64120d"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:43 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-9face24b-08c3-4cf4-95bd-27a9b95bb643 req-8038c4fe-6b90-4264-91da-9269cab6db5d service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:43 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-9face24b-08c3-4cf4-95bd-27a9b95bb643 req-8038c4fe-6b90-4264-91da-9269cab6db5d service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:43 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-9face24b-08c3-4cf4-95bd-27a9b95bb643 req-8038c4fe-6b90-4264-91da-9269cab6db5d service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:43 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-9face24b-08c3-4cf4-95bd-27a9b95bb643 req-8038c4fe-6b90-4264-91da-9269cab6db5d service nova] Creating event network-vif-deleted:37a7d258-7421-45a2-a4ba-5efa8c64120d for instance 2da62263-7d42-447d-abee-597a75abb16f on user Apr 21 15:37:43 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-9face24b-08c3-4cf4-95bd-27a9b95bb643 req-8038c4fe-6b90-4264-91da-9269cab6db5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071606 Apr 21 15:37:43 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 82/238] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 15:37:44 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-6804ec6d-02a9-400a-beec-bfc653a3041a req-1e8846a4-e2cc-48eb-adb8-9b4873b2adbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da62263-7d42-447d-abee-597a75abb16f", "name": "network-vif-plugged", "status": "completed", "tag": "37a7d258-7421-45a2-a4ba-5efa8c64120d"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:44 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-6804ec6d-02a9-400a-beec-bfc653a3041a req-1e8846a4-e2cc-48eb-adb8-9b4873b2adbf service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:44 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-6804ec6d-02a9-400a-beec-bfc653a3041a req-1e8846a4-e2cc-48eb-adb8-9b4873b2adbf service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:44 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-6804ec6d-02a9-400a-beec-bfc653a3041a req-1e8846a4-e2cc-48eb-adb8-9b4873b2adbf service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:44 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-6804ec6d-02a9-400a-beec-bfc653a3041a req-1e8846a4-e2cc-48eb-adb8-9b4873b2adbf service nova] Creating event network-vif-plugged:37a7d258-7421-45a2-a4ba-5efa8c64120d for instance 2da62263-7d42-447d-abee-597a75abb16f on user Apr 21 15:37:44 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-6804ec6d-02a9-400a-beec-bfc653a3041a req-1e8846a4-e2cc-48eb-adb8-9b4873b2adbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035132 Apr 21 15:37:44 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 79/239] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:45 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-55da046e-7b42-495f-9c22-1c0014bb9825 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Action: 'create', calling method: .version_select at 0x7f0c148f6200>, body: {"keypair": {"name": "tempest-keypair-1874765417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8nqP72tANzDnEA8lrOtdWp4/0Py0suJeK+upZsCZXXthrxj4Ko7v4gI+CaeUCTNJTvowubpluvbbOeGPudXy6NaCg+u4j1TV0VlcDBwNORaNmW4JAWbrA4yd2q/Y9CAA=="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:45 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-55da046e-7b42-495f-9c22-1c0014bb9825 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Getting quotas for project 5fd0ca20473c4272858416eec21729af. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:37:45 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-55da046e-7b42-495f-9c22-1c0014bb9825 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Getting quotas for user 01e796b65ab8485ca455f943b3ec2808 and project 5fd0ca20473c4272858416eec21729af. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:37:45 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-55da046e-7b42-495f-9c22-1c0014bb9825 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.112062 Apr 21 15:37:45 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 79/240] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 21 15:37:45 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 21 15:37:46 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-949f5971-9acf-4450-9d78-c43c57dcaa65 req-04a55166-347f-45e2-aecc-cda899fff363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6235b26b-a923-41f1-9cf6-d8761ee099d5", "tag": "7a23dbe1-4dcd-48b5-9847-2760cf7dfbba"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-949f5971-9acf-4450-9d78-c43c57dcaa65 req-04a55166-347f-45e2-aecc-cda899fff363 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-949f5971-9acf-4450-9d78-c43c57dcaa65 req-04a55166-347f-45e2-aecc-cda899fff363 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-949f5971-9acf-4450-9d78-c43c57dcaa65 req-04a55166-347f-45e2-aecc-cda899fff363 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:46 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-949f5971-9acf-4450-9d78-c43c57dcaa65 req-04a55166-347f-45e2-aecc-cda899fff363 service nova] Creating event network-changed:7a23dbe1-4dcd-48b5-9847-2760cf7dfbba for instance 6235b26b-a923-41f1-9cf6-d8761ee099d5 on user Apr 21 15:37:46 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-949f5971-9acf-4450-9d78-c43c57dcaa65 req-04a55166-347f-45e2-aecc-cda899fff363 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032810 Apr 21 15:37:46 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 83/241] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:47 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1944647413", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f4ae5480-8a1a-4dcd-a5ad-0bce204ebf13"}], "security_groups": [{"name": "tempest-securitygroup--1088083188"}], "key_name": "tempest-keypair-1874765417", "user_data": "}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:47 user devstack@n-api.service[61512]: DEBUG nova.network.neutron [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] validate_networks() for [('f4ae5480-8a1a-4dcd-a5ad-0bce204ebf13', None, None, None, None, None)] {{(pid=61512) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Flavor limits 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Image limits 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Flavor pref 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Image pref 0:0:0 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG nova.virt.hardware [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Getting quotas for project 5fd0ca20473c4272858416eec21729af. Resources: {'ram', 'cores', 'instances'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Getting quotas for user 01e796b65ab8485ca455f943b3ec2808 and project 5fd0ca20473c4272858416eec21729af. Resources: {'ram', 'cores', 'instances'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Going to run 1 instances... {{(pid=61512) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:37:48 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: db6cadfe-b33c-4e4b-867a-dce34e0b4958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:37:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-5b621eab-5d34-4b77-9ff4-2c57cd6d6869 req-0680f643-3e20-4698-b4b5-fd9e06e523f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6235b26b-a923-41f1-9cf6-d8761ee099d5", "name": "network-vif-plugged", "status": "completed", "tag": "7a23dbe1-4dcd-48b5-9847-2760cf7dfbba"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-5b621eab-5d34-4b77-9ff4-2c57cd6d6869 req-0680f643-3e20-4698-b4b5-fd9e06e523f1 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-5b621eab-5d34-4b77-9ff4-2c57cd6d6869 req-0680f643-3e20-4698-b4b5-fd9e06e523f1 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-5b621eab-5d34-4b77-9ff4-2c57cd6d6869 req-0680f643-3e20-4698-b4b5-fd9e06e523f1 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:48 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-5b621eab-5d34-4b77-9ff4-2c57cd6d6869 req-0680f643-3e20-4698-b4b5-fd9e06e523f1 service nova] Creating event network-vif-plugged:7a23dbe1-4dcd-48b5-9847-2760cf7dfbba for instance 6235b26b-a923-41f1-9cf6-d8761ee099d5 on user Apr 21 15:37:48 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-5b621eab-5d34-4b77-9ff4-2c57cd6d6869 req-0680f643-3e20-4698-b4b5-fd9e06e523f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288099 Apr 21 15:37:48 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 80/242] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:48 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-4fbc2043-6c36-4742-bfa9-f1423a12caf6 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.969659 Apr 21 15:37:48 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 80/243] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 15:37:47 2023] POST /compute/v2.1/servers => generated 400 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 15:37:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-c4fc2918-fac3-42c1-98e7-086009ef23fd tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:48 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-c4fc2918-fac3-42c1-98e7-086009ef23fd tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: db6cadfe-b33c-4e4b-867a-dce34e0b4958] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:48 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-c4fc2918-fac3-42c1-98e7-086009ef23fd tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:37:48 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-c4fc2918-fac3-42c1-98e7-086009ef23fd tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:37:48 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-c4fc2918-fac3-42c1-98e7-086009ef23fd tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:37:48 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-c4fc2918-fac3-42c1-98e7-086009ef23fd tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958" status: 200 len: 1276 microversion: 2.20 time: 0.125167 Apr 21 15:37:48 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 84/244] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:37:48 2023] GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958 => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:37:50 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-4824f7b0-51cf-483b-9b85-312054729d0e req-5b4d9323-403a-4d33-969e-41a8e10f12de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6235b26b-a923-41f1-9cf6-d8761ee099d5", "name": "network-vif-plugged", "status": "completed", "tag": "7a23dbe1-4dcd-48b5-9847-2760cf7dfbba"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-4824f7b0-51cf-483b-9b85-312054729d0e req-5b4d9323-403a-4d33-969e-41a8e10f12de service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-4824f7b0-51cf-483b-9b85-312054729d0e req-5b4d9323-403a-4d33-969e-41a8e10f12de service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-4824f7b0-51cf-483b-9b85-312054729d0e req-5b4d9323-403a-4d33-969e-41a8e10f12de service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:50 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-4824f7b0-51cf-483b-9b85-312054729d0e req-5b4d9323-403a-4d33-969e-41a8e10f12de service nova] Creating event network-vif-plugged:7a23dbe1-4dcd-48b5-9847-2760cf7dfbba for instance 6235b26b-a923-41f1-9cf6-d8761ee099d5 on user Apr 21 15:37:50 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-4824f7b0-51cf-483b-9b85-312054729d0e req-5b4d9323-403a-4d33-969e-41a8e10f12de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031280 Apr 21 15:37:50 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 81/245] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:50 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-92fa3c5f-ea66-41aa-98b7-9ff885d8a5e8 req-370cd956-a171-4c46-bfd8-453d36954b9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6cadfe-b33c-4e4b-867a-dce34e0b4958", "tag": "4a4a6004-4fff-4ea1-ae75-d5b8d0427883"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:50 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-92fa3c5f-ea66-41aa-98b7-9ff885d8a5e8 req-370cd956-a171-4c46-bfd8-453d36954b9b service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:50 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-92fa3c5f-ea66-41aa-98b7-9ff885d8a5e8 req-370cd956-a171-4c46-bfd8-453d36954b9b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:50 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-92fa3c5f-ea66-41aa-98b7-9ff885d8a5e8 req-370cd956-a171-4c46-bfd8-453d36954b9b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:50 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-92fa3c5f-ea66-41aa-98b7-9ff885d8a5e8 req-370cd956-a171-4c46-bfd8-453d36954b9b service nova] Creating event network-changed:4a4a6004-4fff-4ea1-ae75-d5b8d0427883 for instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 on user Apr 21 15:37:50 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-92fa3c5f-ea66-41aa-98b7-9ff885d8a5e8 req-370cd956-a171-4c46-bfd8-453d36954b9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045794 Apr 21 15:37:50 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 81/246] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:51 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-4eaee270-b3ee-41e9-8818-633e3fda2fc1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-4eaee270-b3ee-41e9-8818-633e3fda2fc1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 4861f0f0-4b0b-485b-888b-f876d6136a0e] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-4eaee270-b3ee-41e9-8818-633e3fda2fc1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-4eaee270-b3ee-41e9-8818-633e3fda2fc1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-4eaee270-b3ee-41e9-8818-633e3fda2fc1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-4eaee270-b3ee-41e9-8818-633e3fda2fc1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-4eaee270-b3ee-41e9-8818-633e3fda2fc1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-4eaee270-b3ee-41e9-8818-633e3fda2fc1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:52 user devstack@n-api.service[61511]: INFO nova.api.openstack.wsgi [None req-4eaee270-b3ee-41e9-8818-633e3fda2fc1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] HTTP exception thrown: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-4eaee270-b3ee-41e9-8818-633e3fda2fc1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Request method failure captured: Apr 21 15:37:52 user devstack@n-api.service[61511]: request: GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e HTTP/1.1 Apr 21 15:37:52 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:37:52 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:37:52 user devstack@n-api.service[61511]: Connection: close Apr 21 15:37:52 user devstack@n-api.service[61511]: Content-Length: 0 Apr 21 15:37:52 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:37:52 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:37:52 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:37:52 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQqx8Gv7A-nqSAxci8ycp4bbjS21DnMHkubeZnlMzsuQ0IBs11Wmb27W5yh2wwvRCHkCHY7yBeH8-pQxB3a-c2hsGt6JN6XHGMSjsy0Fh6iZLI5XRX1SKCNaeZpuA03MEBX57sfF0vk3cO2wpitA70pLWrYX7k-fSZN-4IF_VSKkALKQ Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Project-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Project-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Tenant: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Tenant-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:37:52 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:37:52 user devstack@n-api.service[61511]: X-User: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:37:52 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:37:52 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:37:52 user devstack@n-api.service[61511]: X-User-Id: 27b6dad090b84d0d9b0a8c3f6421a4b0 Apr 21 15:37:52 user devstack@n-api.service[61511]: X-User-Name: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:37:52 user devstack@n-api.service[61511]: method: > Apr 21 15:37:52 user devstack@n-api.service[61511]: exception: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:37:52 user devstack@n-api.service[61511]: action_args: {'id': '4861f0f0-4b0b-485b-888b-f876d6136a0e'} Apr 21 15:37:52 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:37:52 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-4eaee270-b3ee-41e9-8818-633e3fda2fc1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Returning 404 to user: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:37:52 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-4eaee270-b3ee-41e9-8818-633e3fda2fc1 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e" status: 404 len: 111 microversion: 2.1 time: 0.270109 Apr 21 15:37:52 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 85/247] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:37:51 2023] GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e => generated 111 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:37:52 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-1f60ec65-878c-41a0-9418-690d657b52fe tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '.version_select at 0x7f0c146c4ee0>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:52 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-1f60ec65-878c-41a0-9418-690d657b52fe tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874569475" status: 202 len: 0 microversion: 2.1 time: 0.024660 Apr 21 15:37:52 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 82/248] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 15:37:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874569475 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:37:52 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-f45c51a4-84f7-4c72-b824-602cff412147 req-f6d7f38e-9dcb-4606-a19e-a510a4d4fd41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6cadfe-b33c-4e4b-867a-dce34e0b4958", "name": "network-vif-plugged", "status": "completed", "tag": "4a4a6004-4fff-4ea1-ae75-d5b8d0427883"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-b1a302fc-4aed-4376-adb6-244751acb2dd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Action: 'create', calling method: .version_select at 0x7f0c14537490>, body: {"keypair": {"name": "tempest-keypair-1513664595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOcAOSB/wghId0Mp2WYhednzc86G+ps1IePxgWqAkYgb0T0Wccimz/0cb+rPS6c2S7FmccnPAfmcc7oArEvIabS4X5QGpWqWBP7nk7LhsZ4LBYvlLR3dAbGEFLgu9yQWw=="}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:52 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-f45c51a4-84f7-4c72-b824-602cff412147 req-f6d7f38e-9dcb-4606-a19e-a510a4d4fd41 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:52 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-f45c51a4-84f7-4c72-b824-602cff412147 req-f6d7f38e-9dcb-4606-a19e-a510a4d4fd41 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:52 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-f45c51a4-84f7-4c72-b824-602cff412147 req-f6d7f38e-9dcb-4606-a19e-a510a4d4fd41 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-b1a302fc-4aed-4376-adb6-244751acb2dd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Getting quotas for project 9de04c4cc5f140c08c23e34065a9b59a. Resources: {'key_pairs'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:37:52 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-b1a302fc-4aed-4376-adb6-244751acb2dd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Getting quotas for user 27b6dad090b84d0d9b0a8c3f6421a4b0 and project 9de04c4cc5f140c08c23e34065a9b59a. Resources: {'key_pairs'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:37:52 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-f45c51a4-84f7-4c72-b824-602cff412147 req-f6d7f38e-9dcb-4606-a19e-a510a4d4fd41 service nova] Creating event network-vif-plugged:4a4a6004-4fff-4ea1-ae75-d5b8d0427883 for instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 on user Apr 21 15:37:52 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-f45c51a4-84f7-4c72-b824-602cff412147 req-f6d7f38e-9dcb-4606-a19e-a510a4d4fd41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091226 Apr 21 15:37:52 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 82/249] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:52 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-b1a302fc-4aed-4376-adb6-244751acb2dd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063417 Apr 21 15:37:52 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 86/250] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:37:52 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:54 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1022132633", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "df728346-27f5-4b62-955a-45e68bcde88d"}], "security_groups": [{"name": "tempest-securitygroup--1655248041"}], "key_name": "tempest-keypair-1513664595", "user_data": "}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:54 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] validate_networks() for [('df728346-27f5-4b62-955a-45e68bcde88d', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:37:54 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-32a470cd-5c71-4e95-b3e8-907287da3c44 req-08bff715-d7a0-4ca9-8d53-61505674f450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6cadfe-b33c-4e4b-867a-dce34e0b4958", "name": "network-vif-plugged", "status": "completed", "tag": "4a4a6004-4fff-4ea1-ae75-d5b8d0427883"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-32a470cd-5c71-4e95-b3e8-907287da3c44 req-08bff715-d7a0-4ca9-8d53-61505674f450 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-32a470cd-5c71-4e95-b3e8-907287da3c44 req-08bff715-d7a0-4ca9-8d53-61505674f450 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-32a470cd-5c71-4e95-b3e8-907287da3c44 req-08bff715-d7a0-4ca9-8d53-61505674f450 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:54 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-32a470cd-5c71-4e95-b3e8-907287da3c44 req-08bff715-d7a0-4ca9-8d53-61505674f450 service nova] Creating event network-vif-plugged:4a4a6004-4fff-4ea1-ae75-d5b8d0427883 for instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 on user Apr 21 15:37:54 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-32a470cd-5c71-4e95-b3e8-907287da3c44 req-08bff715-d7a0-4ca9-8d53-61505674f450 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035373 Apr 21 15:37:54 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 83/251] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Getting quotas for project 9de04c4cc5f140c08c23e34065a9b59a. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Getting quotas for user 27b6dad090b84d0d9b0a8c3f6421a4b0 and project 9de04c4cc5f140c08c23e34065a9b59a. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:37:55 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: b2f75d23-c00f-4c8b-a5e7-988f048434a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:37:55 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f55e45e2-6d29-426f-b03f-4e5114068789 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.750916 Apr 21 15:37:55 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 83/252] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:37:54 2023] POST /compute/v2.1/servers => generated 400 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:37:55 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-346210c2-7cc9-4059-af9d-b46824d87df7 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:37:55 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-346210c2-7cc9-4059-af9d-b46824d87df7 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: b2f75d23-c00f-4c8b-a5e7-988f048434a8] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:55 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-346210c2-7cc9-4059-af9d-b46824d87df7 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b6dad090b84d0d9b0a8c3f6421a4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de04c4cc5f140c08c23e34065a9b59a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:37:55 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-346210c2-7cc9-4059-af9d-b46824d87df7 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8" status: 200 len: 1236 microversion: 2.1 time: 0.084349 Apr 21 15:37:55 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 87/253] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:37:55 2023] GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8 => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:37:56 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-f27c2923-4c9e-4d81-921b-2c657e27504e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-212391089"}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:56 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-f27c2923-4c9e-4d81-921b-2c657e27504e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: a2d2b868-5cc3-4349-850e-0246b1836705] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:37:56 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-f27c2923-4c9e-4d81-921b-2c657e27504e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:56 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-f27c2923-4c9e-4d81-921b-2c657e27504e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:56 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-f27c2923-4c9e-4d81-921b-2c657e27504e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:56 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-f27c2923-4c9e-4d81-921b-2c657e27504e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:56 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-f27c2923-4c9e-4d81-921b-2c657e27504e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:56 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-f27c2923-4c9e-4d81-921b-2c657e27504e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:57 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-f27c2923-4c9e-4d81-921b-2c657e27504e tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705/action" status: 202 len: 52 microversion: 2.87 time: 1.033855 Apr 21 15:37:57 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 84/254] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 21 15:37:56 2023] POST /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705/action => generated 52 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 21 15:37:58 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-cb4b5f70-485c-41c0-b957-3a8bd319c910 req-f934026c-287f-44a4-b502-f774eb77d4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f75d23-c00f-4c8b-a5e7-988f048434a8", "tag": "f8bd1b72-0611-4c98-9f8c-62db28703ed6"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:37:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-cb4b5f70-485c-41c0-b957-3a8bd319c910 req-f934026c-287f-44a4-b502-f774eb77d4d5 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:37:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-cb4b5f70-485c-41c0-b957-3a8bd319c910 req-f934026c-287f-44a4-b502-f774eb77d4d5 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:37:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-cb4b5f70-485c-41c0-b957-3a8bd319c910 req-f934026c-287f-44a4-b502-f774eb77d4d5 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:37:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-cb4b5f70-485c-41c0-b957-3a8bd319c910 req-f934026c-287f-44a4-b502-f774eb77d4d5 service nova] Creating event network-changed:f8bd1b72-0611-4c98-9f8c-62db28703ed6 for instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 on user Apr 21 15:37:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-cb4b5f70-485c-41c0-b957-3a8bd319c910 req-f934026c-287f-44a4-b502-f774eb77d4d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033395 Apr 21 15:37:58 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 84/255] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:37:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:38:01 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-e5d24de5-85a0-4a0e-af65-c54683fda5fa req-3d2dcd95-c774-443f-8051-e6b7722714cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f75d23-c00f-4c8b-a5e7-988f048434a8", "name": "network-vif-plugged", "status": "completed", "tag": "f8bd1b72-0611-4c98-9f8c-62db28703ed6"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:38:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e5d24de5-85a0-4a0e-af65-c54683fda5fa req-3d2dcd95-c774-443f-8051-e6b7722714cd service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e5d24de5-85a0-4a0e-af65-c54683fda5fa req-3d2dcd95-c774-443f-8051-e6b7722714cd service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:01 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e5d24de5-85a0-4a0e-af65-c54683fda5fa req-3d2dcd95-c774-443f-8051-e6b7722714cd service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:01 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-e5d24de5-85a0-4a0e-af65-c54683fda5fa req-3d2dcd95-c774-443f-8051-e6b7722714cd service nova] Creating event network-vif-plugged:f8bd1b72-0611-4c98-9f8c-62db28703ed6 for instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 on user Apr 21 15:38:01 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-e5d24de5-85a0-4a0e-af65-c54683fda5fa req-3d2dcd95-c774-443f-8051-e6b7722714cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034238 Apr 21 15:38:01 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 88/256] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:38:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:38:03 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:03 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=8 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:03 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-d7030666-69f6-4d32-a576-7f7e007f7cd1 req-ebbff271-f9cc-43fb-83d4-5f4efaa86e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f75d23-c00f-4c8b-a5e7-988f048434a8", "name": "network-vif-plugged", "status": "completed", "tag": "f8bd1b72-0611-4c98-9f8c-62db28703ed6"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:38:03 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:03 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-d7030666-69f6-4d32-a576-7f7e007f7cd1 req-ebbff271-f9cc-43fb-83d4-5f4efaa86e1e service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:03 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-d7030666-69f6-4d32-a576-7f7e007f7cd1 req-ebbff271-f9cc-43fb-83d4-5f4efaa86e1e service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:03 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-d7030666-69f6-4d32-a576-7f7e007f7cd1 req-ebbff271-f9cc-43fb-83d4-5f4efaa86e1e service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:03 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:03 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-d7030666-69f6-4d32-a576-7f7e007f7cd1 req-ebbff271-f9cc-43fb-83d4-5f4efaa86e1e service nova] Creating event network-vif-plugged:f8bd1b72-0611-4c98-9f8c-62db28703ed6 for instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 on user Apr 21 15:38:03 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-d7030666-69f6-4d32-a576-7f7e007f7cd1 req-ebbff271-f9cc-43fb-83d4-5f4efaa86e1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043159 Apr 21 15:38:03 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 85/257] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:38:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ad90b74d-c195-4264-9517-d209403b7967 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-ad90b74d-c195-4264-9517-d209403b7967 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: a2d2b868-5cc3-4349-850e-0246b1836705] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ad90b74d-c195-4264-9517-d209403b7967 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ad90b74d-c195-4264-9517-d209403b7967 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ad90b74d-c195-4264-9517-d209403b7967 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ad90b74d-c195-4264-9517-d209403b7967 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ad90b74d-c195-4264-9517-d209403b7967 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ad90b74d-c195-4264-9517-d209403b7967 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=23 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-ad90b74d-c195-4264-9517-d209403b7967 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-ad90b74d-c195-4264-9517-d209403b7967 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:38:03 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-ad90b74d-c195-4264-9517-d209403b7967 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:38:03 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-ad90b74d-c195-4264-9517-d209403b7967 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705" status: 200 len: 1691 microversion: 2.87 time: 0.226039 Apr 21 15:38:03 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 85/258] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:38:03 2023] GET /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705 => generated 1691 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:38:05 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-f9c18e27-7c73-4c2a-a0b8-2868448978d1 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:38:05 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-f9c18e27-7c73-4c2a-a0b8-2868448978d1 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:38:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f9c18e27-7c73-4c2a-a0b8-2868448978d1 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f9c18e27-7c73-4c2a-a0b8-2868448978d1 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f9c18e27-7c73-4c2a-a0b8-2868448978d1 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f9c18e27-7c73-4c2a-a0b8-2868448978d1 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f9c18e27-7c73-4c2a-a0b8-2868448978d1 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:05 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-f9c18e27-7c73-4c2a-a0b8-2868448978d1 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:05 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=14 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:05 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-f9c18e27-7c73-4c2a-a0b8-2868448978d1 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:38:05 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-f9c18e27-7c73-4c2a-a0b8-2868448978d1 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1657 microversion: 2.1 time: 0.227931 Apr 21 15:38:05 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 89/259] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:38:05 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1657 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:38:05 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-5279af63-3a30-4e6a-858d-000df4aa0f19 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:38:05 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-5279af63-3a30-4e6a-858d-000df4aa0f19 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:38:05 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-5279af63-3a30-4e6a-858d-000df4aa0f19 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:05 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-5279af63-3a30-4e6a-858d-000df4aa0f19 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:05 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-5279af63-3a30-4e6a-858d-000df4aa0f19 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:05 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-5279af63-3a30-4e6a-858d-000df4aa0f19 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:05 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-5279af63-3a30-4e6a-858d-000df4aa0f19 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:05 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-5279af63-3a30-4e6a-858d-000df4aa0f19 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:05 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-5279af63-3a30-4e6a-858d-000df4aa0f19 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:38:05 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-5279af63-3a30-4e6a-858d-000df4aa0f19 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1657 microversion: 2.1 time: 0.246379 Apr 21 15:38:05 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 86/260] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:38:05 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1657 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:38:05 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-caceeb0b-0070-4f0b-a63a-c3f6294d0ecb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:38:05 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-caceeb0b-0070-4f0b-a63a-c3f6294d0ecb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:38:05 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:05 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=10 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-caceeb0b-0070-4f0b-a63a-c3f6294d0ecb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-caceeb0b-0070-4f0b-a63a-c3f6294d0ecb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-caceeb0b-0070-4f0b-a63a-c3f6294d0ecb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-caceeb0b-0070-4f0b-a63a-c3f6294d0ecb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-caceeb0b-0070-4f0b-a63a-c3f6294d0ecb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:05 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-caceeb0b-0070-4f0b-a63a-c3f6294d0ecb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:06 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-caceeb0b-0070-4f0b-a63a-c3f6294d0ecb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:38:06 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-caceeb0b-0070-4f0b-a63a-c3f6294d0ecb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1657 microversion: 2.1 time: 0.238223 Apr 21 15:38:06 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 86/261] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:38:05 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1657 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:38:30 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-b96e8ae4-40d0-406a-9bcf-6d9d995a08a8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:38:30 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-b96e8ae4-40d0-406a-9bcf-6d9d995a08a8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 6235b26b-a923-41f1-9cf6-d8761ee099d5] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:38:30 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:30 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:30 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-b96e8ae4-40d0-406a-9bcf-6d9d995a08a8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:30 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-b96e8ae4-40d0-406a-9bcf-6d9d995a08a8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:30 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-b96e8ae4-40d0-406a-9bcf-6d9d995a08a8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:30 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-b96e8ae4-40d0-406a-9bcf-6d9d995a08a8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:30 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-b96e8ae4-40d0-406a-9bcf-6d9d995a08a8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:30 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-b96e8ae4-40d0-406a-9bcf-6d9d995a08a8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:30 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-b96e8ae4-40d0-406a-9bcf-6d9d995a08a8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125905d0824740b98235b346068bdb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78462ef768874f1e96974e457bcb0198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:38:30 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-b96e8ae4-40d0-406a-9bcf-6d9d995a08a8 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6235b26b-a923-41f1-9cf6-d8761ee099d5" status: 200 len: 1496 microversion: 2.1 time: 0.227703 Apr 21 15:38:30 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 90/262] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:38:30 2023] GET /compute/v2.1/servers/6235b26b-a923-41f1-9cf6-d8761ee099d5 => generated 1496 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:38:31 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-247fe594-73f6-4b79-9a48-29f6b19a04dd tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:38:31 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-247fe594-73f6-4b79-9a48-29f6b19a04dd tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] [instance: 2da62263-7d42-447d-abee-597a75abb16f] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:38:31 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=3 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:31 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=7 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:31 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-247fe594-73f6-4b79-9a48-29f6b19a04dd tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:31 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-247fe594-73f6-4b79-9a48-29f6b19a04dd tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:31 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-247fe594-73f6-4b79-9a48-29f6b19a04dd tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:31 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-247fe594-73f6-4b79-9a48-29f6b19a04dd tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:31 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-247fe594-73f6-4b79-9a48-29f6b19a04dd tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:31 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-247fe594-73f6-4b79-9a48-29f6b19a04dd tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:31 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-247fe594-73f6-4b79-9a48-29f6b19a04dd tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] HTTP exception thrown: Instance 2da62263-7d42-447d-abee-597a75abb16f could not be found. Apr 21 15:38:31 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-247fe594-73f6-4b79-9a48-29f6b19a04dd tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Request method failure captured: Apr 21 15:38:31 user devstack@n-api.service[61512]: request: GET /compute/v2.1/servers/2da62263-7d42-447d-abee-597a75abb16f HTTP/1.1 Apr 21 15:38:31 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:38:31 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:38:31 user devstack@n-api.service[61512]: Connection: close Apr 21 15:38:31 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:38:31 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:38:31 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:38:31 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:38:31 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQqxx1kpWNXw6tUaa6IWpAywwnckUN9YHznHVP1IMrVHAKQmJaHCMRUWMlscIfgpVmPy-xHDqSAjkcvlNmQyPRdxwqIylXxxC-nEsNV77EnIc8KZc62wLcCmDqT4dl19nes5yY4yD5XJJCpevQ6nWfdJPn3CgEedBTufR6LoRsb87tbc Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Project-Id: 9caeb7a6f3674392afae6edf987420fa Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2010293687 Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9caeb7a6f3674392afae6edf987420fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9caeb7a6f3674392afae6edf987420fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9caeb7a6f3674392afae6edf987420fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2010293687 Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Tenant-Id: 9caeb7a6f3674392afae6edf987420fa Apr 21 15:38:31 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2010293687 Apr 21 15:38:31 user devstack@n-api.service[61512]: X-User: tempest-ServerRescueNegativeTestJSON-2010293687-project-member Apr 21 15:38:31 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:38:31 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:38:31 user devstack@n-api.service[61512]: X-User-Id: fc4e5168c1014774b77090a1eeb56abf Apr 21 15:38:31 user devstack@n-api.service[61512]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2010293687-project-member Apr 21 15:38:31 user devstack@n-api.service[61512]: method: > Apr 21 15:38:31 user devstack@n-api.service[61512]: exception: Instance 2da62263-7d42-447d-abee-597a75abb16f could not be found. Apr 21 15:38:31 user devstack@n-api.service[61512]: action_args: {'id': '2da62263-7d42-447d-abee-597a75abb16f'} Apr 21 15:38:31 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2da62263-7d42-447d-abee-597a75abb16f could not be found. Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2da62263-7d42-447d-abee-597a75abb16f could not be found. Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2da62263-7d42-447d-abee-597a75abb16f could not be found. Apr 21 15:38:31 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:38:31 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-247fe594-73f6-4b79-9a48-29f6b19a04dd tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] Returning 404 to user: Instance 2da62263-7d42-447d-abee-597a75abb16f could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:38:31 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-247fe594-73f6-4b79-9a48-29f6b19a04dd tempest-ServerRescueNegativeTestJSON-2010293687 tempest-ServerRescueNegativeTestJSON-2010293687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2da62263-7d42-447d-abee-597a75abb16f" status: 404 len: 111 microversion: 2.1 time: 0.036705 Apr 21 15:38:31 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 87/263] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:38:31 2023] GET /compute/v2.1/servers/2da62263-7d42-447d-abee-597a75abb16f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b30581aa-d4e3-4bc9-8b40-baeb49473036 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-b30581aa-d4e3-4bc9-8b40-baeb49473036 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: db6cadfe-b33c-4e4b-867a-dce34e0b4958] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=5 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=11 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b30581aa-d4e3-4bc9-8b40-baeb49473036 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b30581aa-d4e3-4bc9-8b40-baeb49473036 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b30581aa-d4e3-4bc9-8b40-baeb49473036 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b30581aa-d4e3-4bc9-8b40-baeb49473036 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b30581aa-d4e3-4bc9-8b40-baeb49473036 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b30581aa-d4e3-4bc9-8b40-baeb49473036 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-b30581aa-d4e3-4bc9-8b40-baeb49473036 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-b30581aa-d4e3-4bc9-8b40-baeb49473036 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:38:38 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-b30581aa-d4e3-4bc9-8b40-baeb49473036 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:38:38 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b30581aa-d4e3-4bc9-8b40-baeb49473036 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958" status: 200 len: 1588 microversion: 2.20 time: 0.245790 Apr 21 15:38:38 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 87/264] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:38:38 2023] GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958 => generated 1588 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:38:39 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-cbec5ffa-dbe1-49fe-9c8e-b7454cfcd02a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:38:39 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-cbec5ffa-dbe1-49fe-9c8e-b7454cfcd02a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: e948aeec-acfe-4862-8f6a-28e02c05c46c] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:38:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-cbec5ffa-dbe1-49fe-9c8e-b7454cfcd02a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-cbec5ffa-dbe1-49fe-9c8e-b7454cfcd02a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-cbec5ffa-dbe1-49fe-9c8e-b7454cfcd02a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-cbec5ffa-dbe1-49fe-9c8e-b7454cfcd02a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-cbec5ffa-dbe1-49fe-9c8e-b7454cfcd02a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-cbec5ffa-dbe1-49fe-9c8e-b7454cfcd02a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:40 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-cbec5ffa-dbe1-49fe-9c8e-b7454cfcd02a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c07c4b2ee5404db0ad5e5126dcdfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a34de8879c43bcb72b8eb70df45700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:38:40 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-cbec5ffa-dbe1-49fe-9c8e-b7454cfcd02a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c" status: 200 len: 1493 microversion: 2.1 time: 0.220844 Apr 21 15:38:40 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 91/265] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:38:39 2023] GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c => generated 1493 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:38:45 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-076c8038-73bf-49be-ab5b-9fd8235091c5 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:38:45 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-076c8038-73bf-49be-ab5b-9fd8235091c5 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: b2f75d23-c00f-4c8b-a5e7-988f048434a8] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:38:45 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:45 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:38:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-076c8038-73bf-49be-ab5b-9fd8235091c5 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-076c8038-73bf-49be-ab5b-9fd8235091c5 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-076c8038-73bf-49be-ab5b-9fd8235091c5 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-076c8038-73bf-49be-ab5b-9fd8235091c5 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:38:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-076c8038-73bf-49be-ab5b-9fd8235091c5 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:38:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-076c8038-73bf-49be-ab5b-9fd8235091c5 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:38:45 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-076c8038-73bf-49be-ab5b-9fd8235091c5 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b6dad090b84d0d9b0a8c3f6421a4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de04c4cc5f140c08c23e34065a9b59a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:38:45 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-076c8038-73bf-49be-ab5b-9fd8235091c5 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8" status: 200 len: 1546 microversion: 2.1 time: 0.216231 Apr 21 15:38:45 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 88/266] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:38:45 2023] GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8 => generated 1546 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-734078005", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "destination_type": "volume"}], "networks": [{"uuid": "d9985060-7ec3-46f0-88bf-4d31d3a04bb5"}]}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] validate_networks() for [('d9985060-7ec3-46f0-88bf-4d31d3a04bb5', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Getting quotas for project 0a0f7bbaef144dd48802a9fec82525fc. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Getting quotas for user e2bcea96817e44e0b433b42e617329a1 and project 0a0f7bbaef144dd48802a9fec82525fc. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:39:04 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:39:04 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-ab093534-fa5b-4fb4-b6a5-76e456df216f tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.561341 Apr 21 15:39:04 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 88/267] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 15:39:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 15:39:04 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-f2fc0cc6-2a05-4c94-856d-4b8eebb5ebaf tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:04 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-f2fc0cc6-2a05-4c94-856d-4b8eebb5ebaf tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:04 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=4 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:04 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=12 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:04 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-f2fc0cc6-2a05-4c94-856d-4b8eebb5ebaf tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:04 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-f2fc0cc6-2a05-4c94-856d-4b8eebb5ebaf tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:04 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-f2fc0cc6-2a05-4c94-856d-4b8eebb5ebaf tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:04 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-f2fc0cc6-2a05-4c94-856d-4b8eebb5ebaf tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa20bf4d-f709-412a-a2ac-fd4406082cd6" status: 200 len: 1394 microversion: 2.87 time: 0.087093 Apr 21 15:39:04 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 92/268] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:39:04 2023] GET /compute/v2.1/servers/fa20bf4d-f709-412a-a2ac-fd4406082cd6 => generated 1394 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:39:07 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-c29f6a1f-1f17-4167-b936-15ae650ea42d req-28a1cef0-a45b-4792-a201-62b655193ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa20bf4d-f709-412a-a2ac-fd4406082cd6", "tag": "99408c3d-fbc9-4167-8cf3-7cd1fe4358fb"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:07 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:07 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=6 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:07 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-c29f6a1f-1f17-4167-b936-15ae650ea42d req-28a1cef0-a45b-4792-a201-62b655193ab2 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:07 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-c29f6a1f-1f17-4167-b936-15ae650ea42d req-28a1cef0-a45b-4792-a201-62b655193ab2 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:07 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-c29f6a1f-1f17-4167-b936-15ae650ea42d req-28a1cef0-a45b-4792-a201-62b655193ab2 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:07 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-c29f6a1f-1f17-4167-b936-15ae650ea42d req-28a1cef0-a45b-4792-a201-62b655193ab2 service nova] Creating event network-changed:99408c3d-fbc9-4167-8cf3-7cd1fe4358fb for instance fa20bf4d-f709-412a-a2ac-fd4406082cd6 on user Apr 21 15:39:07 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-c29f6a1f-1f17-4167-b936-15ae650ea42d req-28a1cef0-a45b-4792-a201-62b655193ab2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033454 Apr 21 15:39:07 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 89/269] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:07 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c05aad38-66af-47b2-a6c1-8fd1a50631fb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:07 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c05aad38-66af-47b2-a6c1-8fd1a50631fb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c05aad38-66af-47b2-a6c1-8fd1a50631fb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c05aad38-66af-47b2-a6c1-8fd1a50631fb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c05aad38-66af-47b2-a6c1-8fd1a50631fb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c05aad38-66af-47b2-a6c1-8fd1a50631fb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c05aad38-66af-47b2-a6c1-8fd1a50631fb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:07 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c05aad38-66af-47b2-a6c1-8fd1a50631fb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:08 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-c05aad38-66af-47b2-a6c1-8fd1a50631fb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:08 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c05aad38-66af-47b2-a6c1-8fd1a50631fb tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1657 microversion: 2.1 time: 0.603432 Apr 21 15:39:08 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 89/270] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:39:07 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1657 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:39:08 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-f5a3502a-d01e-432e-b6bf-9910ed80f98b req-d98370ea-849f-422e-b1a5-fcf035d87399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa20bf4d-f709-412a-a2ac-fd4406082cd6", "name": "network-vif-deleted", "tag": "99408c3d-fbc9-4167-8cf3-7cd1fe4358fb"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:08 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-f5a3502a-d01e-432e-b6bf-9910ed80f98b req-d98370ea-849f-422e-b1a5-fcf035d87399 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:08 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-f5a3502a-d01e-432e-b6bf-9910ed80f98b req-d98370ea-849f-422e-b1a5-fcf035d87399 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:08 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-f5a3502a-d01e-432e-b6bf-9910ed80f98b req-d98370ea-849f-422e-b1a5-fcf035d87399 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:08 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.compute.server_external_events [req-f5a3502a-d01e-432e-b6bf-9910ed80f98b req-d98370ea-849f-422e-b1a5-fcf035d87399 service nova] Unable to find a host for instance fa20bf4d-f709-412a-a2ac-fd4406082cd6. Dropping event network-vif-deleted {{(pid=61511) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 21 15:39:08 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-f5a3502a-d01e-432e-b6bf-9910ed80f98b req-d98370ea-849f-422e-b1a5-fcf035d87399 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.030281 Apr 21 15:39:08 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 93/271] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:08 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 21 15:39:32 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:32 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:32 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-d7e91ee4-4669-42aa-abcd-4a374640993e tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:32 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-d7e91ee4-4669-42aa-abcd-4a374640993e tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 6235b26b-a923-41f1-9cf6-d8761ee099d5] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:32 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d7e91ee4-4669-42aa-abcd-4a374640993e tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:32 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d7e91ee4-4669-42aa-abcd-4a374640993e tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:32 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d7e91ee4-4669-42aa-abcd-4a374640993e tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:32 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d7e91ee4-4669-42aa-abcd-4a374640993e tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:32 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d7e91ee4-4669-42aa-abcd-4a374640993e tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:32 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d7e91ee4-4669-42aa-abcd-4a374640993e tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:32 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-d7e91ee4-4669-42aa-abcd-4a374640993e tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 6235b26b-a923-41f1-9cf6-d8761ee099d5] Going to try to terminate instance {{(pid=61512) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:39:32 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-d7e91ee4-4669-42aa-abcd-4a374640993e tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6235b26b-a923-41f1-9cf6-d8761ee099d5" status: 204 len: 0 microversion: 2.1 time: 0.115391 Apr 21 15:39:32 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 90/272] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:39:32 2023] DELETE /compute/v2.1/servers/6235b26b-a923-41f1-9cf6-d8761ee099d5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-4ad44e61-ce91-44a5-b6da-2f6235393143 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-4ad44e61-ce91-44a5-b6da-2f6235393143 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 6235b26b-a923-41f1-9cf6-d8761ee099d5] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=8 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4ad44e61-ce91-44a5-b6da-2f6235393143 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4ad44e61-ce91-44a5-b6da-2f6235393143 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4ad44e61-ce91-44a5-b6da-2f6235393143 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4ad44e61-ce91-44a5-b6da-2f6235393143 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4ad44e61-ce91-44a5-b6da-2f6235393143 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-4ad44e61-ce91-44a5-b6da-2f6235393143 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:32 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-4ad44e61-ce91-44a5-b6da-2f6235393143 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125905d0824740b98235b346068bdb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78462ef768874f1e96974e457bcb0198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:32 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-7532249d-d90b-4d6e-8b86-00546154bed6 req-269e5056-7e62-4ebe-8872-9789bbf54cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6235b26b-a923-41f1-9cf6-d8761ee099d5", "name": "network-vif-unplugged", "status": "completed", "tag": "7a23dbe1-4dcd-48b5-9847-2760cf7dfbba"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:33 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-4ad44e61-ce91-44a5-b6da-2f6235393143 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6235b26b-a923-41f1-9cf6-d8761ee099d5" status: 200 len: 1502 microversion: 2.1 time: 0.257502 Apr 21 15:39:33 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 90/273] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:39:32 2023] GET /compute/v2.1/servers/6235b26b-a923-41f1-9cf6-d8761ee099d5 => generated 1502 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:39:33 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:33 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=8 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:33 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:33 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-7532249d-d90b-4d6e-8b86-00546154bed6 req-269e5056-7e62-4ebe-8872-9789bbf54cfe service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:33 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-7532249d-d90b-4d6e-8b86-00546154bed6 req-269e5056-7e62-4ebe-8872-9789bbf54cfe service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:33 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-7532249d-d90b-4d6e-8b86-00546154bed6 req-269e5056-7e62-4ebe-8872-9789bbf54cfe service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:33 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-7532249d-d90b-4d6e-8b86-00546154bed6 req-269e5056-7e62-4ebe-8872-9789bbf54cfe service nova] Creating event network-vif-unplugged:7a23dbe1-4dcd-48b5-9847-2760cf7dfbba for instance 6235b26b-a923-41f1-9cf6-d8761ee099d5 on user Apr 21 15:39:33 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-7532249d-d90b-4d6e-8b86-00546154bed6 req-269e5056-7e62-4ebe-8872-9789bbf54cfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039042 Apr 21 15:39:33 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 94/274] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:33 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-4b8f2411-5bdd-4e0a-b27d-fabb7ee94859 req-65ede3cf-ccdc-4349-a255-f87d01ee88b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6235b26b-a923-41f1-9cf6-d8761ee099d5", "name": "network-vif-deleted", "tag": "7a23dbe1-4dcd-48b5-9847-2760cf7dfbba"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:33 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-4b8f2411-5bdd-4e0a-b27d-fabb7ee94859 req-65ede3cf-ccdc-4349-a255-f87d01ee88b8 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:33 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-4b8f2411-5bdd-4e0a-b27d-fabb7ee94859 req-65ede3cf-ccdc-4349-a255-f87d01ee88b8 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:33 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-4b8f2411-5bdd-4e0a-b27d-fabb7ee94859 req-65ede3cf-ccdc-4349-a255-f87d01ee88b8 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:33 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-4b8f2411-5bdd-4e0a-b27d-fabb7ee94859 req-65ede3cf-ccdc-4349-a255-f87d01ee88b8 service nova] Creating event network-vif-deleted:7a23dbe1-4dcd-48b5-9847-2760cf7dfbba for instance 6235b26b-a923-41f1-9cf6-d8761ee099d5 on user Apr 21 15:39:33 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-4b8f2411-5bdd-4e0a-b27d-fabb7ee94859 req-65ede3cf-ccdc-4349-a255-f87d01ee88b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034752 Apr 21 15:39:33 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 91/275] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:35 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-16364177-c889-4be2-9d1a-558c329f5ab9 req-8e375e65-e665-43e2-adee-740da2bf48d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6235b26b-a923-41f1-9cf6-d8761ee099d5", "name": "network-vif-plugged", "status": "completed", "tag": "7a23dbe1-4dcd-48b5-9847-2760cf7dfbba"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-16364177-c889-4be2-9d1a-558c329f5ab9 req-8e375e65-e665-43e2-adee-740da2bf48d3 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-16364177-c889-4be2-9d1a-558c329f5ab9 req-8e375e65-e665-43e2-adee-740da2bf48d3 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-16364177-c889-4be2-9d1a-558c329f5ab9 req-8e375e65-e665-43e2-adee-740da2bf48d3 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-16364177-c889-4be2-9d1a-558c329f5ab9 req-8e375e65-e665-43e2-adee-740da2bf48d3 service nova] Creating event network-vif-plugged:7a23dbe1-4dcd-48b5-9847-2760cf7dfbba for instance 6235b26b-a923-41f1-9cf6-d8761ee099d5 on user Apr 21 15:39:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-16364177-c889-4be2-9d1a-558c329f5ab9 req-8e375e65-e665-43e2-adee-740da2bf48d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028435 Apr 21 15:39:35 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 91/276] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:38 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-91e029d8-a969-4a73-922a-5c99a7dcb8df tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:38 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-91e029d8-a969-4a73-922a-5c99a7dcb8df tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: db6cadfe-b33c-4e4b-867a-dce34e0b4958] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-91e029d8-a969-4a73-922a-5c99a7dcb8df tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-91e029d8-a969-4a73-922a-5c99a7dcb8df tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-91e029d8-a969-4a73-922a-5c99a7dcb8df tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-91e029d8-a969-4a73-922a-5c99a7dcb8df tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-91e029d8-a969-4a73-922a-5c99a7dcb8df tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-91e029d8-a969-4a73-922a-5c99a7dcb8df tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:38 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-91e029d8-a969-4a73-922a-5c99a7dcb8df tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.166468 Apr 21 15:39:38 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 95/277] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 21 15:39:38 2023] GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958/os-interface => generated 282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:39:39 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-9ad8782b-1ade-4e3f-874c-b551a31743b4 req-b9f209f4-afd7-44af-bb82-81a2f0afba9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db6cadfe-b33c-4e4b-867a-dce34e0b4958", "tag": "4a4a6004-4fff-4ea1-ae75-d5b8d0427883"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-9ad8782b-1ade-4e3f-874c-b551a31743b4 req-b9f209f4-afd7-44af-bb82-81a2f0afba9a service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-9ad8782b-1ade-4e3f-874c-b551a31743b4 req-b9f209f4-afd7-44af-bb82-81a2f0afba9a service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-9ad8782b-1ade-4e3f-874c-b551a31743b4 req-b9f209f4-afd7-44af-bb82-81a2f0afba9a service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:39 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-9ad8782b-1ade-4e3f-874c-b551a31743b4 req-b9f209f4-afd7-44af-bb82-81a2f0afba9a service nova] Creating event network-changed:4a4a6004-4fff-4ea1-ae75-d5b8d0427883 for instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 on user Apr 21 15:39:39 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-9ad8782b-1ade-4e3f-874c-b551a31743b4 req-b9f209f4-afd7-44af-bb82-81a2f0afba9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032459 Apr 21 15:39:39 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 92/278] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-8c2e23b7-883c-4769-a3c6-c2042c5f4a35 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:39 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-8c2e23b7-883c-4769-a3c6-c2042c5f4a35 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: db6cadfe-b33c-4e4b-867a-dce34e0b4958] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8c2e23b7-883c-4769-a3c6-c2042c5f4a35 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8c2e23b7-883c-4769-a3c6-c2042c5f4a35 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8c2e23b7-883c-4769-a3c6-c2042c5f4a35 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8c2e23b7-883c-4769-a3c6-c2042c5f4a35 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8c2e23b7-883c-4769-a3c6-c2042c5f4a35 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-8c2e23b7-883c-4769-a3c6-c2042c5f4a35 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-8c2e23b7-883c-4769-a3c6-c2042c5f4a35 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958/ips" status: 200 len: 110 microversion: 2.20 time: 0.038021 Apr 21 15:39:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 92/279] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 21 15:39:39 2023] GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958/ips => generated 110 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-67d343f5-0bae-438f-bf22-fad3539a2b56 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-67d343f5-0bae-438f-bf22-fad3539a2b56 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: db6cadfe-b33c-4e4b-867a-dce34e0b4958] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-67d343f5-0bae-438f-bf22-fad3539a2b56 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-67d343f5-0bae-438f-bf22-fad3539a2b56 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-67d343f5-0bae-438f-bf22-fad3539a2b56 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-67d343f5-0bae-438f-bf22-fad3539a2b56 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-67d343f5-0bae-438f-bf22-fad3539a2b56 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-67d343f5-0bae-438f-bf22-fad3539a2b56 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-67d343f5-0bae-438f-bf22-fad3539a2b56 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: db6cadfe-b33c-4e4b-867a-dce34e0b4958] Going to try to terminate instance {{(pid=61511) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:39:41 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-67d343f5-0bae-438f-bf22-fad3539a2b56 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958" status: 204 len: 0 microversion: 2.20 time: 0.139183 Apr 21 15:39:41 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 96/280] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 15:39:41 2023] DELETE /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 15:39:41 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-ac4a8c46-608c-4c15-a35d-dd3ae3646532 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:41 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-ac4a8c46-608c-4c15-a35d-dd3ae3646532 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: db6cadfe-b33c-4e4b-867a-dce34e0b4958] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ac4a8c46-608c-4c15-a35d-dd3ae3646532 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ac4a8c46-608c-4c15-a35d-dd3ae3646532 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ac4a8c46-608c-4c15-a35d-dd3ae3646532 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ac4a8c46-608c-4c15-a35d-dd3ae3646532 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ac4a8c46-608c-4c15-a35d-dd3ae3646532 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:41 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-ac4a8c46-608c-4c15-a35d-dd3ae3646532 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:41 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-d73624bc-bb5b-4714-b3ba-2b3233ecd29a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:41 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-d73624bc-bb5b-4714-b3ba-2b3233ecd29a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: e948aeec-acfe-4862-8f6a-28e02c05c46c] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d73624bc-bb5b-4714-b3ba-2b3233ecd29a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d73624bc-bb5b-4714-b3ba-2b3233ecd29a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d73624bc-bb5b-4714-b3ba-2b3233ecd29a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d73624bc-bb5b-4714-b3ba-2b3233ecd29a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d73624bc-bb5b-4714-b3ba-2b3233ecd29a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d73624bc-bb5b-4714-b3ba-2b3233ecd29a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:41 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-ac4a8c46-608c-4c15-a35d-dd3ae3646532 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:41 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-ac4a8c46-608c-4c15-a35d-dd3ae3646532 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:41 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-ac4a8c46-608c-4c15-a35d-dd3ae3646532 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:41 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-ac4a8c46-608c-4c15-a35d-dd3ae3646532 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958" status: 200 len: 1713 microversion: 2.20 time: 0.323341 Apr 21 15:39:41 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 93/281] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:39:41 2023] GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958 => generated 1713 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-8beb2b42-2cdd-422d-bfe9-bdb45c310283 req-f0338d59-5509-4325-a6eb-0a68f4801288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6cadfe-b33c-4e4b-867a-dce34e0b4958", "name": "network-vif-unplugged", "status": "completed", "tag": "4a4a6004-4fff-4ea1-ae75-d5b8d0427883"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-8beb2b42-2cdd-422d-bfe9-bdb45c310283 req-f0338d59-5509-4325-a6eb-0a68f4801288 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-8beb2b42-2cdd-422d-bfe9-bdb45c310283 req-f0338d59-5509-4325-a6eb-0a68f4801288 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-8beb2b42-2cdd-422d-bfe9-bdb45c310283 req-f0338d59-5509-4325-a6eb-0a68f4801288 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:41 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-8beb2b42-2cdd-422d-bfe9-bdb45c310283 req-f0338d59-5509-4325-a6eb-0a68f4801288 service nova] Creating event network-vif-unplugged:4a4a6004-4fff-4ea1-ae75-d5b8d0427883 for instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 on user Apr 21 15:39:41 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-8beb2b42-2cdd-422d-bfe9-bdb45c310283 req-f0338d59-5509-4325-a6eb-0a68f4801288 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029481 Apr 21 15:39:41 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 97/282] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:41 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-d73624bc-bb5b-4714-b3ba-2b3233ecd29a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c07c4b2ee5404db0ad5e5126dcdfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a34de8879c43bcb72b8eb70df45700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:41 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-d73624bc-bb5b-4714-b3ba-2b3233ecd29a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c" status: 200 len: 1493 microversion: 2.1 time: 0.353198 Apr 21 15:39:41 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 93/283] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:39:41 2023] GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c => generated 1493 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:39:43 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-961936cd-056f-4d49-8e5d-2e36f62561b0 req-892ef26a-a55f-458a-a529-18a9edf32987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db6cadfe-b33c-4e4b-867a-dce34e0b4958", "name": "network-vif-plugged", "status": "completed", "tag": "4a4a6004-4fff-4ea1-ae75-d5b8d0427883"}, {"server_uuid": "db6cadfe-b33c-4e4b-867a-dce34e0b4958", "name": "network-vif-deleted", "tag": "4a4a6004-4fff-4ea1-ae75-d5b8d0427883"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:43 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-961936cd-056f-4d49-8e5d-2e36f62561b0 req-892ef26a-a55f-458a-a529-18a9edf32987 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:43 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-961936cd-056f-4d49-8e5d-2e36f62561b0 req-892ef26a-a55f-458a-a529-18a9edf32987 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:43 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-961936cd-056f-4d49-8e5d-2e36f62561b0 req-892ef26a-a55f-458a-a529-18a9edf32987 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:43 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-961936cd-056f-4d49-8e5d-2e36f62561b0 req-892ef26a-a55f-458a-a529-18a9edf32987 service nova] Creating event network-vif-plugged:4a4a6004-4fff-4ea1-ae75-d5b8d0427883 for instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 on user Apr 21 15:39:43 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-961936cd-056f-4d49-8e5d-2e36f62561b0 req-892ef26a-a55f-458a-a529-18a9edf32987 service nova] Creating event network-vif-deleted:4a4a6004-4fff-4ea1-ae75-d5b8d0427883 for instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 on user Apr 21 15:39:43 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-961936cd-056f-4d49-8e5d-2e36f62561b0 req-892ef26a-a55f-458a-a529-18a9edf32987 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034074 Apr 21 15:39:43 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 94/284] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:45 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-7582bfbc-afaf-4b68-b0de-cf07e1230ddc tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:45 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-7582bfbc-afaf-4b68-b0de-cf07e1230ddc tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: b2f75d23-c00f-4c8b-a5e7-988f048434a8] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7582bfbc-afaf-4b68-b0de-cf07e1230ddc tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7582bfbc-afaf-4b68-b0de-cf07e1230ddc tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7582bfbc-afaf-4b68-b0de-cf07e1230ddc tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7582bfbc-afaf-4b68-b0de-cf07e1230ddc tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7582bfbc-afaf-4b68-b0de-cf07e1230ddc tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:45 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7582bfbc-afaf-4b68-b0de-cf07e1230ddc tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:46 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-7582bfbc-afaf-4b68-b0de-cf07e1230ddc tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.179075 Apr 21 15:39:46 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 98/285] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 15:39:45 2023] GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8/os-interface => generated 282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:46 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-879fe66b-64d1-4721-ba91-10e360ef059f req-b9f5c589-d4b6-409a-8cb0-3bb8fce125d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f75d23-c00f-4c8b-a5e7-988f048434a8", "tag": "f8bd1b72-0611-4c98-9f8c-62db28703ed6"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-879fe66b-64d1-4721-ba91-10e360ef059f req-b9f5c589-d4b6-409a-8cb0-3bb8fce125d4 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-879fe66b-64d1-4721-ba91-10e360ef059f req-b9f5c589-d4b6-409a-8cb0-3bb8fce125d4 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-879fe66b-64d1-4721-ba91-10e360ef059f req-b9f5c589-d4b6-409a-8cb0-3bb8fce125d4 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:46 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-879fe66b-64d1-4721-ba91-10e360ef059f req-b9f5c589-d4b6-409a-8cb0-3bb8fce125d4 service nova] Creating event network-changed:f8bd1b72-0611-4c98-9f8c-62db28703ed6 for instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 on user Apr 21 15:39:46 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-879fe66b-64d1-4721-ba91-10e360ef059f req-b9f5c589-d4b6-409a-8cb0-3bb8fce125d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032249 Apr 21 15:39:46 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 94/286] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:46 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-90be518e-02c9-479a-aaf5-4dcd36bd02bb tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:46 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-90be518e-02c9-479a-aaf5-4dcd36bd02bb tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: b2f75d23-c00f-4c8b-a5e7-988f048434a8] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:46 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-90be518e-02c9-479a-aaf5-4dcd36bd02bb tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:46 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-90be518e-02c9-479a-aaf5-4dcd36bd02bb tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:46 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-90be518e-02c9-479a-aaf5-4dcd36bd02bb tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:46 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-90be518e-02c9-479a-aaf5-4dcd36bd02bb tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:46 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-90be518e-02c9-479a-aaf5-4dcd36bd02bb tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:46 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-90be518e-02c9-479a-aaf5-4dcd36bd02bb tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:46 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-90be518e-02c9-479a-aaf5-4dcd36bd02bb tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8/ips" status: 200 len: 108 microversion: 2.1 time: 0.037548 Apr 21 15:39:46 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 95/287] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 15:39:46 2023] GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8/ips => generated 108 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-d9da085f-6a2a-4af7-943f-f03d15844669 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:48 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-d9da085f-6a2a-4af7-943f-f03d15844669 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: b2f75d23-c00f-4c8b-a5e7-988f048434a8] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:48 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-d9da085f-6a2a-4af7-943f-f03d15844669 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:48 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-d9da085f-6a2a-4af7-943f-f03d15844669 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:48 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-d9da085f-6a2a-4af7-943f-f03d15844669 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:48 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-d9da085f-6a2a-4af7-943f-f03d15844669 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:48 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-d9da085f-6a2a-4af7-943f-f03d15844669 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:48 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-d9da085f-6a2a-4af7-943f-f03d15844669 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:48 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-d9da085f-6a2a-4af7-943f-f03d15844669 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: b2f75d23-c00f-4c8b-a5e7-988f048434a8] Going to try to terminate instance {{(pid=61511) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:39:48 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-d9da085f-6a2a-4af7-943f-f03d15844669 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8" status: 204 len: 0 microversion: 2.1 time: 0.121537 Apr 21 15:39:48 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 99/288] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:39:48 2023] DELETE /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:39:48 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-0640f450-412f-42db-a86b-a7a955d87297 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:48 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-0640f450-412f-42db-a86b-a7a955d87297 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: b2f75d23-c00f-4c8b-a5e7-988f048434a8] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0640f450-412f-42db-a86b-a7a955d87297 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0640f450-412f-42db-a86b-a7a955d87297 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0640f450-412f-42db-a86b-a7a955d87297 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0640f450-412f-42db-a86b-a7a955d87297 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0640f450-412f-42db-a86b-a7a955d87297 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:48 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0640f450-412f-42db-a86b-a7a955d87297 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:48 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-7ef066e4-41da-4c1a-9801-647599b2fff5 req-963954ea-132e-4ced-adc1-fbdc3e19b8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f75d23-c00f-4c8b-a5e7-988f048434a8", "name": "network-vif-unplugged", "status": "completed", "tag": "f8bd1b72-0611-4c98-9f8c-62db28703ed6"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:48 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-7ef066e4-41da-4c1a-9801-647599b2fff5 req-963954ea-132e-4ced-adc1-fbdc3e19b8d2 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:48 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-7ef066e4-41da-4c1a-9801-647599b2fff5 req-963954ea-132e-4ced-adc1-fbdc3e19b8d2 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:48 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-7ef066e4-41da-4c1a-9801-647599b2fff5 req-963954ea-132e-4ced-adc1-fbdc3e19b8d2 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:48 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-0640f450-412f-42db-a86b-a7a955d87297 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b6dad090b84d0d9b0a8c3f6421a4b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de04c4cc5f140c08c23e34065a9b59a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:48 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-7ef066e4-41da-4c1a-9801-647599b2fff5 req-963954ea-132e-4ced-adc1-fbdc3e19b8d2 service nova] Creating event network-vif-unplugged:f8bd1b72-0611-4c98-9f8c-62db28703ed6 for instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 on user Apr 21 15:39:48 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-0640f450-412f-42db-a86b-a7a955d87297 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8" status: 200 len: 1671 microversion: 2.1 time: 0.235743 Apr 21 15:39:48 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 95/289] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:39:48 2023] GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8 => generated 1671 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:39:48 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-7ef066e4-41da-4c1a-9801-647599b2fff5 req-963954ea-132e-4ced-adc1-fbdc3e19b8d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036016 Apr 21 15:39:48 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 96/290] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:49 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-2900dcbd-9c76-4883-814a-91a756b3ad12 req-45573a60-4f8b-4377-98dc-0adb2895acd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f75d23-c00f-4c8b-a5e7-988f048434a8", "name": "network-vif-deleted", "tag": "f8bd1b72-0611-4c98-9f8c-62db28703ed6"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:49 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-2900dcbd-9c76-4883-814a-91a756b3ad12 req-45573a60-4f8b-4377-98dc-0adb2895acd0 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:49 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-2900dcbd-9c76-4883-814a-91a756b3ad12 req-45573a60-4f8b-4377-98dc-0adb2895acd0 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:49 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-2900dcbd-9c76-4883-814a-91a756b3ad12 req-45573a60-4f8b-4377-98dc-0adb2895acd0 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:49 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-2900dcbd-9c76-4883-814a-91a756b3ad12 req-45573a60-4f8b-4377-98dc-0adb2895acd0 service nova] Creating event network-vif-deleted:f8bd1b72-0611-4c98-9f8c-62db28703ed6 for instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 on user Apr 21 15:39:49 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-2900dcbd-9c76-4883-814a-91a756b3ad12 req-45573a60-4f8b-4377-98dc-0adb2895acd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031002 Apr 21 15:39:49 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 100/291] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:50 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-0ba96ffe-c8ea-4c26-949e-194a88d42690 req-057e3746-7771-4cd4-a98a-5898c17ca7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f75d23-c00f-4c8b-a5e7-988f048434a8", "name": "network-vif-plugged", "status": "completed", "tag": "f8bd1b72-0611-4c98-9f8c-62db28703ed6"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-0ba96ffe-c8ea-4c26-949e-194a88d42690 req-057e3746-7771-4cd4-a98a-5898c17ca7d6 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-0ba96ffe-c8ea-4c26-949e-194a88d42690 req-057e3746-7771-4cd4-a98a-5898c17ca7d6 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:50 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-0ba96ffe-c8ea-4c26-949e-194a88d42690 req-057e3746-7771-4cd4-a98a-5898c17ca7d6 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:50 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-0ba96ffe-c8ea-4c26-949e-194a88d42690 req-057e3746-7771-4cd4-a98a-5898c17ca7d6 service nova] Creating event network-vif-plugged:f8bd1b72-0611-4c98-9f8c-62db28703ed6 for instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 on user Apr 21 15:39:50 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-0ba96ffe-c8ea-4c26-949e-194a88d42690 req-057e3746-7771-4cd4-a98a-5898c17ca7d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027747 Apr 21 15:39:50 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 96/292] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:54 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:54 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:54 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:54 user devstack@n-api.service[61512]: DEBUG nova.objects.instance [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lazy-loading 'fault' on Instance uuid fa20bf4d-f709-412a-a2ac-fd4406082cd6 {{(pid=61512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 21 15:39:55 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:55 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:55 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:55 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-d8b287b4-4ca8-4c77-a4f6-aaa630f26ac5 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa20bf4d-f709-412a-a2ac-fd4406082cd6" status: 200 len: 1649 microversion: 2.87 time: 0.114745 Apr 21 15:39:55 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 97/293] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:39:54 2023] GET /compute/v2.1/servers/fa20bf4d-f709-412a-a2ac-fd4406082cd6 => generated 1649 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] Going to try to terminate instance {{(pid=61511) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] Doing local delete in cell ec9e962f-7b82-4673-844a-78caa9c9d46e(cell1) {{(pid=61511) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:55 user devstack@n-api.service[61511]: WARNING nova.compute.api [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] instance's host None is down, deleting from database Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] deallocate_for_instance() {{(pid=61511) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] Instance cache missing network info. {{(pid=61511) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] Updating instance_info_cache with network_info: [] {{(pid=61511) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61511) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 21 15:39:55 user devstack@n-api.service[61511]: WARNING nova.compute.api [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 21 15:39:55 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-3db9510a-168f-436f-ade9-92f3373303f8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fa20bf4d-f709-412a-a2ac-fd4406082cd6" status: 204 len: 0 microversion: 2.87 time: 0.366558 Apr 21 15:39:55 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 101/294] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 15:39:55 2023] DELETE /compute/v2.1/servers/fa20bf4d-f709-412a-a2ac-fd4406082cd6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 15:39:55 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f255f0fd-cf9b-4f0f-8232-5945739719b8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:55 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f255f0fd-cf9b-4f0f-8232-5945739719b8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: fa20bf4d-f709-412a-a2ac-fd4406082cd6] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f255f0fd-cf9b-4f0f-8232-5945739719b8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f255f0fd-cf9b-4f0f-8232-5945739719b8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f255f0fd-cf9b-4f0f-8232-5945739719b8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f255f0fd-cf9b-4f0f-8232-5945739719b8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f255f0fd-cf9b-4f0f-8232-5945739719b8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:55 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f255f0fd-cf9b-4f0f-8232-5945739719b8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:55 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-f255f0fd-cf9b-4f0f-8232-5945739719b8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] HTTP exception thrown: Instance fa20bf4d-f709-412a-a2ac-fd4406082cd6 could not be found. Apr 21 15:39:55 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f255f0fd-cf9b-4f0f-8232-5945739719b8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Request method failure captured: Apr 21 15:39:55 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/fa20bf4d-f709-412a-a2ac-fd4406082cd6 HTTP/1.1 Apr 21 15:39:55 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:39:55 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:39:55 user devstack@n-api.service[61510]: Connection: close Apr 21 15:39:55 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:39:55 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:39:55 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:39:55 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:39:55 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqx8v9Hl2zY9jRtYJOk1vIfUY22TEtCPbc9dahYopYaiC_kIYnV3nnJXyz8oM_1neATFYCxoUk_PmozLRRnQt4RJxGYpqApdH-QZkIK9bCNGNXORiP_wp42fwy48UwJYl-EGmfK-eqGtpcBUZ8QmtVAbuoGLE40pCQGgSvr4Yf46wFg Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Openstack-Nova-Api-Version: 2.87 Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Project-Id: 0a0f7bbaef144dd48802a9fec82525fc Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1467086537 Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a0f7bbaef144dd48802a9fec82525fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a0f7bbaef144dd48802a9fec82525fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a0f7bbaef144dd48802a9fec82525fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1467086537 Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Tenant-Id: 0a0f7bbaef144dd48802a9fec82525fc Apr 21 15:39:55 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1467086537 Apr 21 15:39:55 user devstack@n-api.service[61510]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member Apr 21 15:39:55 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:39:55 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:39:55 user devstack@n-api.service[61510]: X-User-Id: e2bcea96817e44e0b433b42e617329a1 Apr 21 15:39:55 user devstack@n-api.service[61510]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member Apr 21 15:39:55 user devstack@n-api.service[61510]: method: > Apr 21 15:39:55 user devstack@n-api.service[61510]: exception: Instance fa20bf4d-f709-412a-a2ac-fd4406082cd6 could not be found. Apr 21 15:39:55 user devstack@n-api.service[61510]: action_args: {'id': 'fa20bf4d-f709-412a-a2ac-fd4406082cd6'} Apr 21 15:39:55 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa20bf4d-f709-412a-a2ac-fd4406082cd6 could not be found. Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa20bf4d-f709-412a-a2ac-fd4406082cd6 could not be found. Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa20bf4d-f709-412a-a2ac-fd4406082cd6 could not be found. Apr 21 15:39:55 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:39:55 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f255f0fd-cf9b-4f0f-8232-5945739719b8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Returning 404 to user: Instance fa20bf4d-f709-412a-a2ac-fd4406082cd6 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:39:55 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f255f0fd-cf9b-4f0f-8232-5945739719b8 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fa20bf4d-f709-412a-a2ac-fd4406082cd6" status: 404 len: 111 microversion: 2.87 time: 0.027337 Apr 21 15:39:55 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 97/295] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:39:55 2023] GET /compute/v2.1/servers/fa20bf4d-f709-412a-a2ac-fd4406082cd6 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 15:39:55 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-d58a65b3-8372-4f47-9f9a-d0ecc8b027fc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:55 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-d58a65b3-8372-4f47-9f9a-d0ecc8b027fc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: a2d2b868-5cc3-4349-850e-0246b1836705] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d58a65b3-8372-4f47-9f9a-d0ecc8b027fc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d58a65b3-8372-4f47-9f9a-d0ecc8b027fc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d58a65b3-8372-4f47-9f9a-d0ecc8b027fc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d58a65b3-8372-4f47-9f9a-d0ecc8b027fc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d58a65b3-8372-4f47-9f9a-d0ecc8b027fc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:55 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-d58a65b3-8372-4f47-9f9a-d0ecc8b027fc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:55 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-d58a65b3-8372-4f47-9f9a-d0ecc8b027fc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: a2d2b868-5cc3-4349-850e-0246b1836705] Going to try to terminate instance {{(pid=61512) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:39:55 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-d58a65b3-8372-4f47-9f9a-d0ecc8b027fc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705" status: 204 len: 0 microversion: 2.87 time: 0.112576 Apr 21 15:39:55 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 98/296] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 15:39:55 2023] DELETE /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-04b95bdc-6f84-4e3c-83cb-c2ee11e21347 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-04b95bdc-6f84-4e3c-83cb-c2ee11e21347 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: a2d2b868-5cc3-4349-850e-0246b1836705] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-04b95bdc-6f84-4e3c-83cb-c2ee11e21347 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-04b95bdc-6f84-4e3c-83cb-c2ee11e21347 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-04b95bdc-6f84-4e3c-83cb-c2ee11e21347 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-04b95bdc-6f84-4e3c-83cb-c2ee11e21347 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-04b95bdc-6f84-4e3c-83cb-c2ee11e21347 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-04b95bdc-6f84-4e3c-83cb-c2ee11e21347 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:55 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=21,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:39:56 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-79740cb9-46ca-422d-a3ac-d6cb9067ae4b req-fb13d121-1bc8-4bf8-8563-bc3096611e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d2b868-5cc3-4349-850e-0246b1836705", "name": "network-vif-unplugged", "status": "completed", "tag": "5966b9ed-8548-40d4-995e-efb217999946"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-79740cb9-46ca-422d-a3ac-d6cb9067ae4b req-fb13d121-1bc8-4bf8-8563-bc3096611e2d service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-79740cb9-46ca-422d-a3ac-d6cb9067ae4b req-fb13d121-1bc8-4bf8-8563-bc3096611e2d service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:56 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-79740cb9-46ca-422d-a3ac-d6cb9067ae4b req-fb13d121-1bc8-4bf8-8563-bc3096611e2d service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:56 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-79740cb9-46ca-422d-a3ac-d6cb9067ae4b req-fb13d121-1bc8-4bf8-8563-bc3096611e2d service nova] Creating event network-vif-unplugged:5966b9ed-8548-40d4-995e-efb217999946 for instance a2d2b868-5cc3-4349-850e-0246b1836705 on user Apr 21 15:39:56 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-79740cb9-46ca-422d-a3ac-d6cb9067ae4b req-fb13d121-1bc8-4bf8-8563-bc3096611e2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030911 Apr 21 15:39:56 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 98/297] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:56 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-04b95bdc-6f84-4e3c-83cb-c2ee11e21347 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:56 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-04b95bdc-6f84-4e3c-83cb-c2ee11e21347 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:56 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-04b95bdc-6f84-4e3c-83cb-c2ee11e21347 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:39:56 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-04b95bdc-6f84-4e3c-83cb-c2ee11e21347 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705" status: 200 len: 1697 microversion: 2.87 time: 0.361261 Apr 21 15:39:56 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 102/298] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:39:55 2023] GET /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705 => generated 1697 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:39:57 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-ffbb327c-c48e-4387-860f-47261a013cff req-a2014020-3a6c-4648-aed6-b9d08ce8d521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d2b868-5cc3-4349-850e-0246b1836705", "name": "network-vif-deleted", "tag": "5966b9ed-8548-40d4-995e-efb217999946"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:57 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-ffbb327c-c48e-4387-860f-47261a013cff req-a2014020-3a6c-4648-aed6-b9d08ce8d521 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:57 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-ffbb327c-c48e-4387-860f-47261a013cff req-a2014020-3a6c-4648-aed6-b9d08ce8d521 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:57 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-ffbb327c-c48e-4387-860f-47261a013cff req-a2014020-3a6c-4648-aed6-b9d08ce8d521 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:57 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-ffbb327c-c48e-4387-860f-47261a013cff req-a2014020-3a6c-4648-aed6-b9d08ce8d521 service nova] Creating event network-vif-deleted:5966b9ed-8548-40d4-995e-efb217999946 for instance a2d2b868-5cc3-4349-850e-0246b1836705 on user Apr 21 15:39:57 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-ffbb327c-c48e-4387-860f-47261a013cff req-a2014020-3a6c-4648-aed6-b9d08ce8d521 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033939 Apr 21 15:39:57 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 99/299] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:39:58 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-eb604a3d-c5c1-4c56-9aed-be15cfa1d4e1 req-0a233ce7-3c3a-440e-9216-e6495e1ae29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2d2b868-5cc3-4349-850e-0246b1836705", "name": "network-vif-plugged", "status": "completed", "tag": "5966b9ed-8548-40d4-995e-efb217999946"}, {"server_uuid": "a2d2b868-5cc3-4349-850e-0246b1836705", "name": "network-vif-plugged", "status": "completed", "tag": "5966b9ed-8548-40d4-995e-efb217999946"}, {"server_uuid": "a2d2b868-5cc3-4349-850e-0246b1836705", "name": "network-vif-plugged", "status": "completed", "tag": "5966b9ed-8548-40d4-995e-efb217999946"}, {"server_uuid": "a2d2b868-5cc3-4349-850e-0246b1836705", "name": "network-vif-unplugged", "status": "completed", "tag": "5966b9ed-8548-40d4-995e-efb217999946"}, {"server_uuid": "a2d2b868-5cc3-4349-850e-0246b1836705", "name": "network-vif-plugged", "status": "completed", "tag": "5966b9ed-8548-40d4-995e-efb217999946"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:39:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-eb604a3d-c5c1-4c56-9aed-be15cfa1d4e1 req-0a233ce7-3c3a-440e-9216-e6495e1ae29c service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:39:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-eb604a3d-c5c1-4c56-9aed-be15cfa1d4e1 req-0a233ce7-3c3a-440e-9216-e6495e1ae29c service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:39:58 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-eb604a3d-c5c1-4c56-9aed-be15cfa1d4e1 req-0a233ce7-3c3a-440e-9216-e6495e1ae29c service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:39:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-eb604a3d-c5c1-4c56-9aed-be15cfa1d4e1 req-0a233ce7-3c3a-440e-9216-e6495e1ae29c service nova] Creating event network-vif-plugged:5966b9ed-8548-40d4-995e-efb217999946 for instance a2d2b868-5cc3-4349-850e-0246b1836705 on user Apr 21 15:39:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-eb604a3d-c5c1-4c56-9aed-be15cfa1d4e1 req-0a233ce7-3c3a-440e-9216-e6495e1ae29c service nova] Creating event network-vif-plugged:5966b9ed-8548-40d4-995e-efb217999946 for instance a2d2b868-5cc3-4349-850e-0246b1836705 on user Apr 21 15:39:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-eb604a3d-c5c1-4c56-9aed-be15cfa1d4e1 req-0a233ce7-3c3a-440e-9216-e6495e1ae29c service nova] Creating event network-vif-plugged:5966b9ed-8548-40d4-995e-efb217999946 for instance a2d2b868-5cc3-4349-850e-0246b1836705 on user Apr 21 15:39:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-eb604a3d-c5c1-4c56-9aed-be15cfa1d4e1 req-0a233ce7-3c3a-440e-9216-e6495e1ae29c service nova] Creating event network-vif-unplugged:5966b9ed-8548-40d4-995e-efb217999946 for instance a2d2b868-5cc3-4349-850e-0246b1836705 on user Apr 21 15:39:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-eb604a3d-c5c1-4c56-9aed-be15cfa1d4e1 req-0a233ce7-3c3a-440e-9216-e6495e1ae29c service nova] Creating event network-vif-plugged:5966b9ed-8548-40d4-995e-efb217999946 for instance a2d2b868-5cc3-4349-850e-0246b1836705 on user Apr 21 15:39:58 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-eb604a3d-c5c1-4c56-9aed-be15cfa1d4e1 req-0a233ce7-3c3a-440e-9216-e6495e1ae29c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.035382 Apr 21 15:39:58 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 99/300] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:39:58 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:40:08 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-82d1dd3a-da54-4eb2-a02e-426b572cbfe2 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:08 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-82d1dd3a-da54-4eb2-a02e-426b572cbfe2 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:08 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=5 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:08 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=3 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:08 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-82d1dd3a-da54-4eb2-a02e-426b572cbfe2 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:08 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-82d1dd3a-da54-4eb2-a02e-426b572cbfe2 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:08 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-82d1dd3a-da54-4eb2-a02e-426b572cbfe2 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:08 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-82d1dd3a-da54-4eb2-a02e-426b572cbfe2 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:08 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-82d1dd3a-da54-4eb2-a02e-426b572cbfe2 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:08 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-82d1dd3a-da54-4eb2-a02e-426b572cbfe2 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:08 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-82d1dd3a-da54-4eb2-a02e-426b572cbfe2 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:40:08 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-82d1dd3a-da54-4eb2-a02e-426b572cbfe2 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1657 microversion: 2.1 time: 0.215314 Apr 21 15:40:08 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 103/301] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:40:08 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1657 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:40:08 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:08 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:08 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-66acfa5e-2be0-4873-8353-b9d749d60b99 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:08 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-66acfa5e-2be0-4873-8353-b9d749d60b99 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:08 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-66acfa5e-2be0-4873-8353-b9d749d60b99 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:08 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-66acfa5e-2be0-4873-8353-b9d749d60b99 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:08 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-66acfa5e-2be0-4873-8353-b9d749d60b99 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:08 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-66acfa5e-2be0-4873-8353-b9d749d60b99 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:08 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-66acfa5e-2be0-4873-8353-b9d749d60b99 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:08 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-66acfa5e-2be0-4873-8353-b9d749d60b99 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:08 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-66acfa5e-2be0-4873-8353-b9d749d60b99 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:40:08 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-66acfa5e-2be0-4873-8353-b9d749d60b99 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1657 microversion: 2.1 time: 0.232129 Apr 21 15:40:08 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 100/302] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:40:08 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1657 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:40:08 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=20 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:08 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=34 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:08 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-069b6c2b-557e-4260-8825-047e10d63add tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:08 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-069b6c2b-557e-4260-8825-047e10d63add tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-069b6c2b-557e-4260-8825-047e10d63add tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-069b6c2b-557e-4260-8825-047e10d63add tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-069b6c2b-557e-4260-8825-047e10d63add tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-069b6c2b-557e-4260-8825-047e10d63add tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-069b6c2b-557e-4260-8825-047e10d63add tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-069b6c2b-557e-4260-8825-047e10d63add tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:09 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-069b6c2b-557e-4260-8825-047e10d63add tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:40:09 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-069b6c2b-557e-4260-8825-047e10d63add tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1657 microversion: 2.1 time: 0.216381 Apr 21 15:40:09 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 100/303] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:40:08 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1657 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-628b29e9-90a3-45d4-8213-19c45c787d4b tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-628b29e9-90a3-45d4-8213-19c45c787d4b tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 6235b26b-a923-41f1-9cf6-d8761ee099d5] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-628b29e9-90a3-45d4-8213-19c45c787d4b tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-628b29e9-90a3-45d4-8213-19c45c787d4b tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-628b29e9-90a3-45d4-8213-19c45c787d4b tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-628b29e9-90a3-45d4-8213-19c45c787d4b tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-628b29e9-90a3-45d4-8213-19c45c787d4b tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-628b29e9-90a3-45d4-8213-19c45c787d4b tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:23 user devstack@n-api.service[61511]: INFO nova.api.openstack.wsgi [None req-628b29e9-90a3-45d4-8213-19c45c787d4b tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] HTTP exception thrown: Instance 6235b26b-a923-41f1-9cf6-d8761ee099d5 could not be found. Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-628b29e9-90a3-45d4-8213-19c45c787d4b tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Request method failure captured: Apr 21 15:40:23 user devstack@n-api.service[61511]: request: GET /compute/v2.1/servers/6235b26b-a923-41f1-9cf6-d8761ee099d5 HTTP/1.1 Apr 21 15:40:23 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:40:23 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:40:23 user devstack@n-api.service[61511]: Connection: close Apr 21 15:40:23 user devstack@n-api.service[61511]: Content-Length: 0 Apr 21 15:40:23 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:40:23 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:40:23 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:40:23 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQq1I8gl6HwBRbxQ6iOpPOPjem8BJYI27KQKjCvu5sMtkgiPBi8DLZteqLKewKi5DuX4CrfqqG2IEXWmQDgH90gFVOeRkwXpvFNycLQAvfjdTcdImevXIiVkYxJBi1uSv2ode9VTehIL8awk-Qw5uB0ZG3YOcTW3LgZGm_QlhTZu2akQ Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Project-Id: 78462ef768874f1e96974e457bcb0198 Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Project-Name: tempest-VolumesAdminNegativeTest-834278185 Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/78462ef768874f1e96974e457bcb0198"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/78462ef768874f1e96974e457bcb0198"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/78462ef768874f1e96974e457bcb0198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Tenant: tempest-VolumesAdminNegativeTest-834278185 Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Tenant-Id: 78462ef768874f1e96974e457bcb0198 Apr 21 15:40:23 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-834278185 Apr 21 15:40:23 user devstack@n-api.service[61511]: X-User: tempest-VolumesAdminNegativeTest-834278185-project-member Apr 21 15:40:23 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:40:23 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:40:23 user devstack@n-api.service[61511]: X-User-Id: 125905d0824740b98235b346068bdb97 Apr 21 15:40:23 user devstack@n-api.service[61511]: X-User-Name: tempest-VolumesAdminNegativeTest-834278185-project-member Apr 21 15:40:23 user devstack@n-api.service[61511]: method: > Apr 21 15:40:23 user devstack@n-api.service[61511]: exception: Instance 6235b26b-a923-41f1-9cf6-d8761ee099d5 could not be found. Apr 21 15:40:23 user devstack@n-api.service[61511]: action_args: {'id': '6235b26b-a923-41f1-9cf6-d8761ee099d5'} Apr 21 15:40:23 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6235b26b-a923-41f1-9cf6-d8761ee099d5 could not be found. Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6235b26b-a923-41f1-9cf6-d8761ee099d5 could not be found. Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6235b26b-a923-41f1-9cf6-d8761ee099d5 could not be found. Apr 21 15:40:23 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-628b29e9-90a3-45d4-8213-19c45c787d4b tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Returning 404 to user: Instance 6235b26b-a923-41f1-9cf6-d8761ee099d5 could not be found. {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:40:23 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-628b29e9-90a3-45d4-8213-19c45c787d4b tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6235b26b-a923-41f1-9cf6-d8761ee099d5" status: 404 len: 111 microversion: 2.1 time: 0.039582 Apr 21 15:40:23 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 104/304] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:40:23 2023] GET /compute/v2.1/servers/6235b26b-a923-41f1-9cf6-d8761ee099d5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:40:23 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-2474324d-c527-4a61-90ff-a7c85906df0c tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:23 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-2474324d-c527-4a61-90ff-a7c85906df0c tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 1570e80b-42fe-48de-a976-f821fdab5f9b] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:23 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:23 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=6 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-2474324d-c527-4a61-90ff-a7c85906df0c tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-2474324d-c527-4a61-90ff-a7c85906df0c tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-2474324d-c527-4a61-90ff-a7c85906df0c tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-2474324d-c527-4a61-90ff-a7c85906df0c tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-2474324d-c527-4a61-90ff-a7c85906df0c tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-2474324d-c527-4a61-90ff-a7c85906df0c tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:23 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-2474324d-c527-4a61-90ff-a7c85906df0c tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 1570e80b-42fe-48de-a976-f821fdab5f9b] Going to try to terminate instance {{(pid=61512) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:40:23 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-2474324d-c527-4a61-90ff-a7c85906df0c tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b" status: 204 len: 0 microversion: 2.1 time: 0.163160 Apr 21 15:40:23 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 101/305] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:40:23 2023] DELETE /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:40:23 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-d412b16b-4dc2-4449-a235-45a4d23c7c35 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:23 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-d412b16b-4dc2-4449-a235-45a4d23c7c35 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 1570e80b-42fe-48de-a976-f821fdab5f9b] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:23 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:23 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d412b16b-4dc2-4449-a235-45a4d23c7c35 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d412b16b-4dc2-4449-a235-45a4d23c7c35 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d412b16b-4dc2-4449-a235-45a4d23c7c35 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d412b16b-4dc2-4449-a235-45a4d23c7c35 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d412b16b-4dc2-4449-a235-45a4d23c7c35 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d412b16b-4dc2-4449-a235-45a4d23c7c35 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:23 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-d412b16b-4dc2-4449-a235-45a4d23c7c35 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125905d0824740b98235b346068bdb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78462ef768874f1e96974e457bcb0198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:40:23 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-d412b16b-4dc2-4449-a235-45a4d23c7c35 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b" status: 200 len: 1671 microversion: 2.1 time: 0.232944 Apr 21 15:40:23 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 101/306] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:40:23 2023] GET /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b => generated 1671 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-f7b3d273-4623-4b03-bb02-dd07c74bc0f7 req-ad9b9743-71b8-4242-a1ae-8411b7b5569a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1570e80b-42fe-48de-a976-f821fdab5f9b", "name": "network-vif-unplugged", "status": "completed", "tag": "606f098b-357f-46e2-b2fc-5be513fb6b35"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-f7b3d273-4623-4b03-bb02-dd07c74bc0f7 req-ad9b9743-71b8-4242-a1ae-8411b7b5569a service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-f7b3d273-4623-4b03-bb02-dd07c74bc0f7 req-ad9b9743-71b8-4242-a1ae-8411b7b5569a service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-f7b3d273-4623-4b03-bb02-dd07c74bc0f7 req-ad9b9743-71b8-4242-a1ae-8411b7b5569a service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:23 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-f7b3d273-4623-4b03-bb02-dd07c74bc0f7 req-ad9b9743-71b8-4242-a1ae-8411b7b5569a service nova] Creating event network-vif-unplugged:606f098b-357f-46e2-b2fc-5be513fb6b35 for instance 1570e80b-42fe-48de-a976-f821fdab5f9b on user Apr 21 15:40:23 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-f7b3d273-4623-4b03-bb02-dd07c74bc0f7 req-ad9b9743-71b8-4242-a1ae-8411b7b5569a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034181 Apr 21 15:40:23 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 105/307] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:40:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:40:24 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-f02848c7-987f-4f8d-ab22-61f1418fce2a req-77164fa9-095f-4f74-9568-f90b3d1e348b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1570e80b-42fe-48de-a976-f821fdab5f9b", "name": "network-vif-deleted", "tag": "606f098b-357f-46e2-b2fc-5be513fb6b35"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:24 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-f02848c7-987f-4f8d-ab22-61f1418fce2a req-77164fa9-095f-4f74-9568-f90b3d1e348b service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:24 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-f02848c7-987f-4f8d-ab22-61f1418fce2a req-77164fa9-095f-4f74-9568-f90b3d1e348b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:24 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-f02848c7-987f-4f8d-ab22-61f1418fce2a req-77164fa9-095f-4f74-9568-f90b3d1e348b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:24 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-f02848c7-987f-4f8d-ab22-61f1418fce2a req-77164fa9-095f-4f74-9568-f90b3d1e348b service nova] Creating event network-vif-deleted:606f098b-357f-46e2-b2fc-5be513fb6b35 for instance 1570e80b-42fe-48de-a976-f821fdab5f9b on user Apr 21 15:40:24 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-f02848c7-987f-4f8d-ab22-61f1418fce2a req-77164fa9-095f-4f74-9568-f90b3d1e348b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032069 Apr 21 15:40:24 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 102/308] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:40:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:40:25 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-37b5249a-a57e-4fa5-ab7f-97e361c79180 req-209c65c1-4b14-4a4f-82bf-91e0204fd017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1570e80b-42fe-48de-a976-f821fdab5f9b", "name": "network-vif-plugged", "status": "completed", "tag": "606f098b-357f-46e2-b2fc-5be513fb6b35"}, {"server_uuid": "1570e80b-42fe-48de-a976-f821fdab5f9b", "name": "network-vif-plugged", "status": "completed", "tag": "606f098b-357f-46e2-b2fc-5be513fb6b35"}, {"server_uuid": "1570e80b-42fe-48de-a976-f821fdab5f9b", "name": "network-vif-plugged", "status": "completed", "tag": "606f098b-357f-46e2-b2fc-5be513fb6b35"}, {"server_uuid": "1570e80b-42fe-48de-a976-f821fdab5f9b", "name": "network-vif-unplugged", "status": "completed", "tag": "606f098b-357f-46e2-b2fc-5be513fb6b35"}, {"server_uuid": "1570e80b-42fe-48de-a976-f821fdab5f9b", "name": "network-vif-plugged", "status": "completed", "tag": "606f098b-357f-46e2-b2fc-5be513fb6b35"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-37b5249a-a57e-4fa5-ab7f-97e361c79180 req-209c65c1-4b14-4a4f-82bf-91e0204fd017 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-37b5249a-a57e-4fa5-ab7f-97e361c79180 req-209c65c1-4b14-4a4f-82bf-91e0204fd017 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-37b5249a-a57e-4fa5-ab7f-97e361c79180 req-209c65c1-4b14-4a4f-82bf-91e0204fd017 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-37b5249a-a57e-4fa5-ab7f-97e361c79180 req-209c65c1-4b14-4a4f-82bf-91e0204fd017 service nova] Creating event network-vif-plugged:606f098b-357f-46e2-b2fc-5be513fb6b35 for instance 1570e80b-42fe-48de-a976-f821fdab5f9b on user Apr 21 15:40:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-37b5249a-a57e-4fa5-ab7f-97e361c79180 req-209c65c1-4b14-4a4f-82bf-91e0204fd017 service nova] Creating event network-vif-plugged:606f098b-357f-46e2-b2fc-5be513fb6b35 for instance 1570e80b-42fe-48de-a976-f821fdab5f9b on user Apr 21 15:40:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-37b5249a-a57e-4fa5-ab7f-97e361c79180 req-209c65c1-4b14-4a4f-82bf-91e0204fd017 service nova] Creating event network-vif-plugged:606f098b-357f-46e2-b2fc-5be513fb6b35 for instance 1570e80b-42fe-48de-a976-f821fdab5f9b on user Apr 21 15:40:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-37b5249a-a57e-4fa5-ab7f-97e361c79180 req-209c65c1-4b14-4a4f-82bf-91e0204fd017 service nova] Creating event network-vif-unplugged:606f098b-357f-46e2-b2fc-5be513fb6b35 for instance 1570e80b-42fe-48de-a976-f821fdab5f9b on user Apr 21 15:40:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-37b5249a-a57e-4fa5-ab7f-97e361c79180 req-209c65c1-4b14-4a4f-82bf-91e0204fd017 service nova] Creating event network-vif-plugged:606f098b-357f-46e2-b2fc-5be513fb6b35 for instance 1570e80b-42fe-48de-a976-f821fdab5f9b on user Apr 21 15:40:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-37b5249a-a57e-4fa5-ab7f-97e361c79180 req-209c65c1-4b14-4a4f-82bf-91e0204fd017 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032668 Apr 21 15:40:25 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 102/309] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:40:25 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:40:31 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-fa442aff-8043-416b-88cd-c8fe6a25602b tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:31 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-fa442aff-8043-416b-88cd-c8fe6a25602b tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: db6cadfe-b33c-4e4b-867a-dce34e0b4958] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:31 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-fa442aff-8043-416b-88cd-c8fe6a25602b tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:31 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-fa442aff-8043-416b-88cd-c8fe6a25602b tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:31 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-fa442aff-8043-416b-88cd-c8fe6a25602b tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:31 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-fa442aff-8043-416b-88cd-c8fe6a25602b tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:31 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-fa442aff-8043-416b-88cd-c8fe6a25602b tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:31 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-fa442aff-8043-416b-88cd-c8fe6a25602b tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:31 user devstack@n-api.service[61511]: INFO nova.api.openstack.wsgi [None req-fa442aff-8043-416b-88cd-c8fe6a25602b tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] HTTP exception thrown: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:40:31 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-fa442aff-8043-416b-88cd-c8fe6a25602b tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Request method failure captured: Apr 21 15:40:31 user devstack@n-api.service[61511]: request: GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958 HTTP/1.1 Apr 21 15:40:31 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:40:31 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:40:31 user devstack@n-api.service[61511]: Connection: close Apr 21 15:40:31 user devstack@n-api.service[61511]: Content-Length: 0 Apr 21 15:40:31 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:40:31 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:40:31 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:40:31 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQq3JAESS7QUZD1OUQnhIujfajBBNFVw4BkZwiZw57LzHKyBT2jdwDYCw1408_ZxQVkKzCG-ZS8FdddWTPHPCHQtdB37S4kpczvcqrE-fiL3opTSadMGdTAZoX3Rv69BXZ_fwhgDQRl05NDCCSSsEJ1HDJ6FfK50ARgPt8TTY2UYwVsA Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Project-Id: 5fd0ca20473c4272858416eec21729af Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fd0ca20473c4272858416eec21729af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fd0ca20473c4272858416eec21729af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5fd0ca20473c4272858416eec21729af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Tenant-Id: 5fd0ca20473c4272858416eec21729af Apr 21 15:40:31 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:40:31 user devstack@n-api.service[61511]: X-User: tempest-AttachVolumeShelveTestJSON-1258148986-project-member Apr 21 15:40:31 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:40:31 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:40:31 user devstack@n-api.service[61511]: X-User-Id: 01e796b65ab8485ca455f943b3ec2808 Apr 21 15:40:31 user devstack@n-api.service[61511]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1258148986-project-member Apr 21 15:40:31 user devstack@n-api.service[61511]: method: > Apr 21 15:40:31 user devstack@n-api.service[61511]: exception: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:40:31 user devstack@n-api.service[61511]: action_args: {'id': 'db6cadfe-b33c-4e4b-867a-dce34e0b4958'} Apr 21 15:40:31 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:40:31 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:31 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-fa442aff-8043-416b-88cd-c8fe6a25602b tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Returning 404 to user: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:40:31 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-fa442aff-8043-416b-88cd-c8fe6a25602b tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958" status: 404 len: 111 microversion: 2.20 time: 0.031810 Apr 21 15:40:31 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 106/310] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:40:31 2023] GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 15:40:31 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-c2179e64-3496-4193-ac5e-747681befe40 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '.version_select at 0x7f0c14653910>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:31 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-c2179e64-3496-4193-ac5e-747681befe40 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874765417" status: 204 len: 0 microversion: 2.20 time: 0.021134 Apr 21 15:40:31 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 103/311] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 21 15:40:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874765417 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 15:40:32 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b000eda3-b20a-416d-9a02-a5aef2a13872 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Action: 'create', calling method: .version_select at 0x7f0c146c5090>, body: {"keypair": {"name": "tempest-keypair-2064319406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOaRxKKy+wy//lwZEYCap9PgnXNQv+lZbWXVRA0woXSNR/dgLDAZFgeJSmSsgD5+joTyWSwRXhjLfpaUfZgwVNQamToz1vJD/ScZTxHekWt3zueylSQvSed+GIdasIeZA=="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:32 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-b000eda3-b20a-416d-9a02-a5aef2a13872 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Getting quotas for project 5fd0ca20473c4272858416eec21729af. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:40:32 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-b000eda3-b20a-416d-9a02-a5aef2a13872 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Getting quotas for user 01e796b65ab8485ca455f943b3ec2808 and project 5fd0ca20473c4272858416eec21729af. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:40:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b000eda3-b20a-416d-9a02-a5aef2a13872 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043680 Apr 21 15:40:32 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 103/312] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 21 15:40:32 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-778817214", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f4ae5480-8a1a-4dcd-a5ad-0bce204ebf13"}], "security_groups": [{"name": "tempest-securitygroup--1027741859"}], "key_name": "tempest-keypair-2064319406", "user_data": "}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] validate_networks() for [('f4ae5480-8a1a-4dcd-a5ad-0bce204ebf13', None, None, None, None, None)] {{(pid=61511) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Flavor limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Image limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Flavor pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Image pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Getting quotas for project 5fd0ca20473c4272858416eec21729af. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Getting quotas for user 01e796b65ab8485ca455f943b3ec2808 and project 5fd0ca20473c4272858416eec21729af. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Going to run 1 instances... {{(pid=61511) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:40:34 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: 56c19929-6499-43ec-8b35-9edef57a737d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:40:34 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-baca43c8-b245-41a4-b4ca-b0cb7601bd06 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.641020 Apr 21 15:40:34 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 107/313] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 21 15:40:34 2023] POST /compute/v2.1/servers => generated 400 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 21 15:40:34 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:34 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-deb55c90-9cef-42b7-8b7d-639821cf41f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:34 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-deb55c90-9cef-42b7-8b7d-639821cf41f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: 56c19929-6499-43ec-8b35-9edef57a737d] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:34 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-deb55c90-9cef-42b7-8b7d-639821cf41f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:40:34 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-deb55c90-9cef-42b7-8b7d-639821cf41f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:40:34 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-deb55c90-9cef-42b7-8b7d-639821cf41f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:40:34 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-deb55c90-9cef-42b7-8b7d-639821cf41f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d" status: 200 len: 1275 microversion: 2.20 time: 0.089060 Apr 21 15:40:34 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 104/314] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:40:34 2023] GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:40:37 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=8 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-601bcb0a-e96a-4a14-9a00-bf88440bfc05 req-14c81a01-b544-4820-93a0-74f57365348c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c19929-6499-43ec-8b35-9edef57a737d", "tag": "3d034010-bd19-48b6-be03-cf18de52fc64"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-601bcb0a-e96a-4a14-9a00-bf88440bfc05 req-14c81a01-b544-4820-93a0-74f57365348c service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-601bcb0a-e96a-4a14-9a00-bf88440bfc05 req-14c81a01-b544-4820-93a0-74f57365348c service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-601bcb0a-e96a-4a14-9a00-bf88440bfc05 req-14c81a01-b544-4820-93a0-74f57365348c service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-601bcb0a-e96a-4a14-9a00-bf88440bfc05 req-14c81a01-b544-4820-93a0-74f57365348c service nova] Creating event network-changed:3d034010-bd19-48b6-be03-cf18de52fc64 for instance 56c19929-6499-43ec-8b35-9edef57a737d on user Apr 21 15:40:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-601bcb0a-e96a-4a14-9a00-bf88440bfc05 req-14c81a01-b544-4820-93a0-74f57365348c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034680 Apr 21 15:40:37 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 104/315] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:40:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:40:38 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-84574bde-1cd9-45a6-96d0-c9c82dec4552 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:38 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-84574bde-1cd9-45a6-96d0-c9c82dec4552 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: b2f75d23-c00f-4c8b-a5e7-988f048434a8] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-84574bde-1cd9-45a6-96d0-c9c82dec4552 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-84574bde-1cd9-45a6-96d0-c9c82dec4552 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-84574bde-1cd9-45a6-96d0-c9c82dec4552 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-84574bde-1cd9-45a6-96d0-c9c82dec4552 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-84574bde-1cd9-45a6-96d0-c9c82dec4552 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:38 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-84574bde-1cd9-45a6-96d0-c9c82dec4552 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:38 user devstack@n-api.service[61511]: INFO nova.api.openstack.wsgi [None req-84574bde-1cd9-45a6-96d0-c9c82dec4552 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] HTTP exception thrown: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:38 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-84574bde-1cd9-45a6-96d0-c9c82dec4552 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Request method failure captured: Apr 21 15:40:38 user devstack@n-api.service[61511]: request: GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8 HTTP/1.1 Apr 21 15:40:38 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:40:38 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:40:38 user devstack@n-api.service[61511]: Connection: close Apr 21 15:40:38 user devstack@n-api.service[61511]: Content-Length: 0 Apr 21 15:40:38 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:40:38 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:40:38 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:40:38 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQqx8Gv7A-nqSAxci8ycp4bbjS21DnMHkubeZnlMzsuQ0IBs11Wmb27W5yh2wwvRCHkCHY7yBeH8-pQxB3a-c2hsGt6JN6XHGMSjsy0Fh6iZLI5XRX1SKCNaeZpuA03MEBX57sfF0vk3cO2wpitA70pLWrYX7k-fSZN-4IF_VSKkALKQ Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Project-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Project-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Tenant: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Tenant-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:38 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:38 user devstack@n-api.service[61511]: X-User: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:38 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:40:38 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:40:38 user devstack@n-api.service[61511]: X-User-Id: 27b6dad090b84d0d9b0a8c3f6421a4b0 Apr 21 15:40:38 user devstack@n-api.service[61511]: X-User-Name: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:38 user devstack@n-api.service[61511]: method: > Apr 21 15:40:38 user devstack@n-api.service[61511]: exception: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:38 user devstack@n-api.service[61511]: action_args: {'id': 'b2f75d23-c00f-4c8b-a5e7-988f048434a8'} Apr 21 15:40:38 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:38 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:38 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-84574bde-1cd9-45a6-96d0-c9c82dec4552 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Returning 404 to user: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:40:38 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-84574bde-1cd9-45a6-96d0-c9c82dec4552 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8" status: 404 len: 111 microversion: 2.1 time: 0.029797 Apr 21 15:40:38 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 108/316] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:40:38 2023] GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:40:38 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-c320f867-f2d9-4237-819f-5d5d439e24dd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '.version_select at 0x7f0c14653910>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:38 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-c320f867-f2d9-4237-819f-5d5d439e24dd tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513664595" status: 202 len: 0 microversion: 2.1 time: 0.024110 Apr 21 15:40:38 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 105/317] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 15:40:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513664595 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-d05b6fde-c60b-4737-8119-310fcbb84225 req-e0dda483-1498-45df-a6fd-ddecaa3be933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c19929-6499-43ec-8b35-9edef57a737d", "name": "network-vif-plugged", "status": "completed", "tag": "3d034010-bd19-48b6-be03-cf18de52fc64"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d05b6fde-c60b-4737-8119-310fcbb84225 req-e0dda483-1498-45df-a6fd-ddecaa3be933 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d05b6fde-c60b-4737-8119-310fcbb84225 req-e0dda483-1498-45df-a6fd-ddecaa3be933 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d05b6fde-c60b-4737-8119-310fcbb84225 req-e0dda483-1498-45df-a6fd-ddecaa3be933 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-d05b6fde-c60b-4737-8119-310fcbb84225 req-e0dda483-1498-45df-a6fd-ddecaa3be933 service nova] Creating event network-vif-plugged:3d034010-bd19-48b6-be03-cf18de52fc64 for instance 56c19929-6499-43ec-8b35-9edef57a737d on user Apr 21 15:40:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-d05b6fde-c60b-4737-8119-310fcbb84225 req-e0dda483-1498-45df-a6fd-ddecaa3be933 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038085 Apr 21 15:40:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 105/318] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:40:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-6ffa8897-55b5-4e8e-b504-21132022ddba tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-6ffa8897-55b5-4e8e-b504-21132022ddba tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: b2f75d23-c00f-4c8b-a5e7-988f048434a8] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-6ffa8897-55b5-4e8e-b504-21132022ddba tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-6ffa8897-55b5-4e8e-b504-21132022ddba tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-6ffa8897-55b5-4e8e-b504-21132022ddba tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-6ffa8897-55b5-4e8e-b504-21132022ddba tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-6ffa8897-55b5-4e8e-b504-21132022ddba tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-6ffa8897-55b5-4e8e-b504-21132022ddba tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:39 user devstack@n-api.service[61511]: INFO nova.api.openstack.wsgi [None req-6ffa8897-55b5-4e8e-b504-21132022ddba tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] HTTP exception thrown: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-6ffa8897-55b5-4e8e-b504-21132022ddba tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Request method failure captured: Apr 21 15:40:39 user devstack@n-api.service[61511]: request: DELETE /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8 HTTP/1.1 Apr 21 15:40:39 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:40:39 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:40:39 user devstack@n-api.service[61511]: Connection: close Apr 21 15:40:39 user devstack@n-api.service[61511]: Content-Length: 0 Apr 21 15:40:39 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:40:39 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:40:39 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:40:39 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQqx8Gv7A-nqSAxci8ycp4bbjS21DnMHkubeZnlMzsuQ0IBs11Wmb27W5yh2wwvRCHkCHY7yBeH8-pQxB3a-c2hsGt6JN6XHGMSjsy0Fh6iZLI5XRX1SKCNaeZpuA03MEBX57sfF0vk3cO2wpitA70pLWrYX7k-fSZN-4IF_VSKkALKQ Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Project-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Project-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Tenant: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Tenant-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:39 user devstack@n-api.service[61511]: X-User: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:39 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:40:39 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:40:39 user devstack@n-api.service[61511]: X-User-Id: 27b6dad090b84d0d9b0a8c3f6421a4b0 Apr 21 15:40:39 user devstack@n-api.service[61511]: X-User-Name: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:39 user devstack@n-api.service[61511]: method: > Apr 21 15:40:39 user devstack@n-api.service[61511]: exception: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:39 user devstack@n-api.service[61511]: action_args: {'id': 'b2f75d23-c00f-4c8b-a5e7-988f048434a8'} Apr 21 15:40:39 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-6ffa8897-55b5-4e8e-b504-21132022ddba tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Returning 404 to user: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:40:39 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-6ffa8897-55b5-4e8e-b504-21132022ddba tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8" status: 404 len: 111 microversion: 2.1 time: 0.033280 Apr 21 15:40:39 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 109/319] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:40:39 2023] DELETE /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:40:39 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-12b38438-6ad5-4352-9e93-56be4a9d9323 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:39 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-12b38438-6ad5-4352-9e93-56be4a9d9323 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: b2f75d23-c00f-4c8b-a5e7-988f048434a8] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-12b38438-6ad5-4352-9e93-56be4a9d9323 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-12b38438-6ad5-4352-9e93-56be4a9d9323 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-12b38438-6ad5-4352-9e93-56be4a9d9323 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-12b38438-6ad5-4352-9e93-56be4a9d9323 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-12b38438-6ad5-4352-9e93-56be4a9d9323 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-12b38438-6ad5-4352-9e93-56be4a9d9323 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:39 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-12b38438-6ad5-4352-9e93-56be4a9d9323 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] HTTP exception thrown: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:39 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-12b38438-6ad5-4352-9e93-56be4a9d9323 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Request method failure captured: Apr 21 15:40:39 user devstack@n-api.service[61512]: request: GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8 HTTP/1.1 Apr 21 15:40:39 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:40:39 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:40:39 user devstack@n-api.service[61512]: Connection: close Apr 21 15:40:39 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:40:39 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:40:39 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:40:39 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:40:39 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQqx8Gv7A-nqSAxci8ycp4bbjS21DnMHkubeZnlMzsuQ0IBs11Wmb27W5yh2wwvRCHkCHY7yBeH8-pQxB3a-c2hsGt6JN6XHGMSjsy0Fh6iZLI5XRX1SKCNaeZpuA03MEBX57sfF0vk3cO2wpitA70pLWrYX7k-fSZN-4IF_VSKkALKQ Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Project-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Project-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Tenant: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Tenant-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:39 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:39 user devstack@n-api.service[61512]: X-User: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:39 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:40:39 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:40:39 user devstack@n-api.service[61512]: X-User-Id: 27b6dad090b84d0d9b0a8c3f6421a4b0 Apr 21 15:40:39 user devstack@n-api.service[61512]: X-User-Name: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:39 user devstack@n-api.service[61512]: method: > Apr 21 15:40:39 user devstack@n-api.service[61512]: exception: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:39 user devstack@n-api.service[61512]: action_args: {'id': 'b2f75d23-c00f-4c8b-a5e7-988f048434a8'} Apr 21 15:40:39 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. Apr 21 15:40:39 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-12b38438-6ad5-4352-9e93-56be4a9d9323 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Returning 404 to user: Instance b2f75d23-c00f-4c8b-a5e7-988f048434a8 could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:40:39 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-12b38438-6ad5-4352-9e93-56be4a9d9323 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8" status: 404 len: 111 microversion: 2.1 time: 0.036670 Apr 21 15:40:39 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 106/320] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:40:39 2023] GET /compute/v2.1/servers/b2f75d23-c00f-4c8b-a5e7-988f048434a8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f474615e-8658-4304-acec-4867d3af4c21 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f474615e-8658-4304-acec-4867d3af4c21 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 4861f0f0-4b0b-485b-888b-f876d6136a0e] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f474615e-8658-4304-acec-4867d3af4c21 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f474615e-8658-4304-acec-4867d3af4c21 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f474615e-8658-4304-acec-4867d3af4c21 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f474615e-8658-4304-acec-4867d3af4c21 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f474615e-8658-4304-acec-4867d3af4c21 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f474615e-8658-4304-acec-4867d3af4c21 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-f474615e-8658-4304-acec-4867d3af4c21 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] HTTP exception thrown: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f474615e-8658-4304-acec-4867d3af4c21 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Request method failure captured: Apr 21 15:40:39 user devstack@n-api.service[61510]: request: DELETE /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e HTTP/1.1 Apr 21 15:40:39 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:40:39 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:40:39 user devstack@n-api.service[61510]: Connection: close Apr 21 15:40:39 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:40:39 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:40:39 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:40:39 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:40:39 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqx8Gv7A-nqSAxci8ycp4bbjS21DnMHkubeZnlMzsuQ0IBs11Wmb27W5yh2wwvRCHkCHY7yBeH8-pQxB3a-c2hsGt6JN6XHGMSjsy0Fh6iZLI5XRX1SKCNaeZpuA03MEBX57sfF0vk3cO2wpitA70pLWrYX7k-fSZN-4IF_VSKkALKQ Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Project-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Tenant-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:39 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:39 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:39 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:40:39 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:40:39 user devstack@n-api.service[61510]: X-User-Id: 27b6dad090b84d0d9b0a8c3f6421a4b0 Apr 21 15:40:39 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:39 user devstack@n-api.service[61510]: method: > Apr 21 15:40:39 user devstack@n-api.service[61510]: exception: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:40:39 user devstack@n-api.service[61510]: action_args: {'id': '4861f0f0-4b0b-485b-888b-f876d6136a0e'} Apr 21 15:40:39 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:40:39 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f474615e-8658-4304-acec-4867d3af4c21 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Returning 404 to user: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:40:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f474615e-8658-4304-acec-4867d3af4c21 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e" status: 404 len: 111 microversion: 2.1 time: 0.048136 Apr 21 15:40:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 106/321] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:40:39 2023] DELETE /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-63c0a3dd-2060-4181-80a6-ba8f3585813f tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-63c0a3dd-2060-4181-80a6-ba8f3585813f tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 4861f0f0-4b0b-485b-888b-f876d6136a0e] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-63c0a3dd-2060-4181-80a6-ba8f3585813f tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-63c0a3dd-2060-4181-80a6-ba8f3585813f tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-63c0a3dd-2060-4181-80a6-ba8f3585813f tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-63c0a3dd-2060-4181-80a6-ba8f3585813f tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-63c0a3dd-2060-4181-80a6-ba8f3585813f tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-63c0a3dd-2060-4181-80a6-ba8f3585813f tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:39 user devstack@n-api.service[61511]: INFO nova.api.openstack.wsgi [None req-63c0a3dd-2060-4181-80a6-ba8f3585813f tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] HTTP exception thrown: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-63c0a3dd-2060-4181-80a6-ba8f3585813f tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Request method failure captured: Apr 21 15:40:39 user devstack@n-api.service[61511]: request: GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e HTTP/1.1 Apr 21 15:40:39 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:40:39 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:40:39 user devstack@n-api.service[61511]: Connection: close Apr 21 15:40:39 user devstack@n-api.service[61511]: Content-Length: 0 Apr 21 15:40:39 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:40:39 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:40:39 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:40:39 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQqx8Gv7A-nqSAxci8ycp4bbjS21DnMHkubeZnlMzsuQ0IBs11Wmb27W5yh2wwvRCHkCHY7yBeH8-pQxB3a-c2hsGt6JN6XHGMSjsy0Fh6iZLI5XRX1SKCNaeZpuA03MEBX57sfF0vk3cO2wpitA70pLWrYX7k-fSZN-4IF_VSKkALKQ Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Project-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Project-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Tenant: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Tenant-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:39 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:39 user devstack@n-api.service[61511]: X-User: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:39 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:40:39 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:40:39 user devstack@n-api.service[61511]: X-User-Id: 27b6dad090b84d0d9b0a8c3f6421a4b0 Apr 21 15:40:39 user devstack@n-api.service[61511]: X-User-Name: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:39 user devstack@n-api.service[61511]: method: > Apr 21 15:40:39 user devstack@n-api.service[61511]: exception: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:40:39 user devstack@n-api.service[61511]: action_args: {'id': '4861f0f0-4b0b-485b-888b-f876d6136a0e'} Apr 21 15:40:39 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. Apr 21 15:40:39 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:40:39 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-63c0a3dd-2060-4181-80a6-ba8f3585813f tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Returning 404 to user: Instance 4861f0f0-4b0b-485b-888b-f876d6136a0e could not be found. {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:40:40 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-63c0a3dd-2060-4181-80a6-ba8f3585813f tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e" status: 404 len: 111 microversion: 2.1 time: 0.036241 Apr 21 15:40:40 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 110/322] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:40:39 2023] GET /compute/v2.1/servers/4861f0f0-4b0b-485b-888b-f876d6136a0e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:40:40 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-15ef09c0-3490-4ae8-89d0-4d1ca91ac1fa tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:40 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-15ef09c0-3490-4ae8-89d0-4d1ca91ac1fa tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 33e531c7-1e26-4ed7-8899-c97983a0fc69] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:40 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-15ef09c0-3490-4ae8-89d0-4d1ca91ac1fa tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:40 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-15ef09c0-3490-4ae8-89d0-4d1ca91ac1fa tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:40 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-15ef09c0-3490-4ae8-89d0-4d1ca91ac1fa tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:40 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-15ef09c0-3490-4ae8-89d0-4d1ca91ac1fa tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:40 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-15ef09c0-3490-4ae8-89d0-4d1ca91ac1fa tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:40 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-15ef09c0-3490-4ae8-89d0-4d1ca91ac1fa tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:40 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-15ef09c0-3490-4ae8-89d0-4d1ca91ac1fa tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] HTTP exception thrown: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:40:40 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-15ef09c0-3490-4ae8-89d0-4d1ca91ac1fa tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Request method failure captured: Apr 21 15:40:40 user devstack@n-api.service[61512]: request: DELETE /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69 HTTP/1.1 Apr 21 15:40:40 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:40:40 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:40:40 user devstack@n-api.service[61512]: Connection: close Apr 21 15:40:40 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:40:40 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:40:40 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:40:40 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:40:40 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQqx8Gv7A-nqSAxci8ycp4bbjS21DnMHkubeZnlMzsuQ0IBs11Wmb27W5yh2wwvRCHkCHY7yBeH8-pQxB3a-c2hsGt6JN6XHGMSjsy0Fh6iZLI5XRX1SKCNaeZpuA03MEBX57sfF0vk3cO2wpitA70pLWrYX7k-fSZN-4IF_VSKkALKQ Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Project-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Project-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Tenant: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Tenant-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:40 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:40 user devstack@n-api.service[61512]: X-User: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:40 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:40:40 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:40:40 user devstack@n-api.service[61512]: X-User-Id: 27b6dad090b84d0d9b0a8c3f6421a4b0 Apr 21 15:40:40 user devstack@n-api.service[61512]: X-User-Name: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:40 user devstack@n-api.service[61512]: method: > Apr 21 15:40:40 user devstack@n-api.service[61512]: exception: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:40:40 user devstack@n-api.service[61512]: action_args: {'id': '33e531c7-1e26-4ed7-8899-c97983a0fc69'} Apr 21 15:40:40 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:40:40 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:40 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-15ef09c0-3490-4ae8-89d0-4d1ca91ac1fa tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Returning 404 to user: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:40:40 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-15ef09c0-3490-4ae8-89d0-4d1ca91ac1fa tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69" status: 404 len: 111 microversion: 2.1 time: 0.050963 Apr 21 15:40:40 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 107/323] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:40:40 2023] DELETE /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:40:40 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f29577d4-af00-499d-b715-a20831c6aad6 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:40 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f29577d4-af00-499d-b715-a20831c6aad6 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] [instance: 33e531c7-1e26-4ed7-8899-c97983a0fc69] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f29577d4-af00-499d-b715-a20831c6aad6 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f29577d4-af00-499d-b715-a20831c6aad6 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f29577d4-af00-499d-b715-a20831c6aad6 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f29577d4-af00-499d-b715-a20831c6aad6 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f29577d4-af00-499d-b715-a20831c6aad6 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f29577d4-af00-499d-b715-a20831c6aad6 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:40 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-f29577d4-af00-499d-b715-a20831c6aad6 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] HTTP exception thrown: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:40:40 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f29577d4-af00-499d-b715-a20831c6aad6 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Request method failure captured: Apr 21 15:40:40 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69 HTTP/1.1 Apr 21 15:40:40 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:40:40 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:40:40 user devstack@n-api.service[61510]: Connection: close Apr 21 15:40:40 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:40:40 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:40:40 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:40:40 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:40:40 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqx8Gv7A-nqSAxci8ycp4bbjS21DnMHkubeZnlMzsuQ0IBs11Wmb27W5yh2wwvRCHkCHY7yBeH8-pQxB3a-c2hsGt6JN6XHGMSjsy0Fh6iZLI5XRX1SKCNaeZpuA03MEBX57sfF0vk3cO2wpitA70pLWrYX7k-fSZN-4IF_VSKkALKQ Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Project-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9de04c4cc5f140c08c23e34065a9b59a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Tenant-Id: 9de04c4cc5f140c08c23e34065a9b59a Apr 21 15:40:40 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-668567586 Apr 21 15:40:40 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:40 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:40:40 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:40:40 user devstack@n-api.service[61510]: X-User-Id: 27b6dad090b84d0d9b0a8c3f6421a4b0 Apr 21 15:40:40 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeNegativeTest-668567586-project-member Apr 21 15:40:40 user devstack@n-api.service[61510]: method: > Apr 21 15:40:40 user devstack@n-api.service[61510]: exception: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:40:40 user devstack@n-api.service[61510]: action_args: {'id': '33e531c7-1e26-4ed7-8899-c97983a0fc69'} Apr 21 15:40:40 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. Apr 21 15:40:40 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:40 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f29577d4-af00-499d-b715-a20831c6aad6 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] Returning 404 to user: Instance 33e531c7-1e26-4ed7-8899-c97983a0fc69 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:40:40 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f29577d4-af00-499d-b715-a20831c6aad6 tempest-AttachVolumeNegativeTest-668567586 tempest-AttachVolumeNegativeTest-668567586-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69" status: 404 len: 111 microversion: 2.1 time: 0.025913 Apr 21 15:40:40 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 107/324] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:40:40 2023] GET /compute/v2.1/servers/33e531c7-1e26-4ed7-8899-c97983a0fc69 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:40:41 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-7d0924d8-4221-402a-8352-65c4de0588eb req-93439e87-24fb-4b7c-850d-1ffdb4daaa8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c19929-6499-43ec-8b35-9edef57a737d", "name": "network-vif-plugged", "status": "completed", "tag": "3d034010-bd19-48b6-be03-cf18de52fc64"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-7d0924d8-4221-402a-8352-65c4de0588eb req-93439e87-24fb-4b7c-850d-1ffdb4daaa8b service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-7d0924d8-4221-402a-8352-65c4de0588eb req-93439e87-24fb-4b7c-850d-1ffdb4daaa8b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:41 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-7d0924d8-4221-402a-8352-65c4de0588eb req-93439e87-24fb-4b7c-850d-1ffdb4daaa8b service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:41 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-7d0924d8-4221-402a-8352-65c4de0588eb req-93439e87-24fb-4b7c-850d-1ffdb4daaa8b service nova] Creating event network-vif-plugged:3d034010-bd19-48b6-be03-cf18de52fc64 for instance 56c19929-6499-43ec-8b35-9edef57a737d on user Apr 21 15:40:41 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-7d0924d8-4221-402a-8352-65c4de0588eb req-93439e87-24fb-4b7c-850d-1ffdb4daaa8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037760 Apr 21 15:40:41 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 111/325] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:40:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-5af9b1e2-1784-45c6-8684-dca34e153652 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-5af9b1e2-1784-45c6-8684-dca34e153652 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: 77788e0b-c833-42c0-ba9b-3e32dce614f5] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-5af9b1e2-1784-45c6-8684-dca34e153652 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-5af9b1e2-1784-45c6-8684-dca34e153652 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-5af9b1e2-1784-45c6-8684-dca34e153652 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-5af9b1e2-1784-45c6-8684-dca34e153652 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-5af9b1e2-1784-45c6-8684-dca34e153652 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-5af9b1e2-1784-45c6-8684-dca34e153652 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:42 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-5af9b1e2-1784-45c6-8684-dca34e153652 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] HTTP exception thrown: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-5af9b1e2-1784-45c6-8684-dca34e153652 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Request method failure captured: Apr 21 15:40:42 user devstack@n-api.service[61512]: request: DELETE /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5 HTTP/1.1 Apr 21 15:40:42 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:40:42 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:40:42 user devstack@n-api.service[61512]: Connection: close Apr 21 15:40:42 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:40:42 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:40:42 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:40:42 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:40:42 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQqxxfn6YsezSe1GwgZo3rylgS0v7jps8BtN4DLw78TQ1Hh1z_-ev4wakoV_vfH6GhiPZncaWjJ4xZ036Q1BGwprYalwXnDUVp0TiciEGlFEP1PbEKOHu1Th6o7-csDT4hBn7rG0UPUPwVAsOIIbz9TW5mkc5gxvMsdw1zA1MwPxgfKk Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Project-Id: c6a34de8879c43bcb72b8eb70df45700 Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Project-Name: tempest-ServersNegativeTestJSON-1218199999 Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6a34de8879c43bcb72b8eb70df45700"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6a34de8879c43bcb72b8eb70df45700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c6a34de8879c43bcb72b8eb70df45700"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Tenant: tempest-ServersNegativeTestJSON-1218199999 Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Tenant-Id: c6a34de8879c43bcb72b8eb70df45700 Apr 21 15:40:42 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1218199999 Apr 21 15:40:42 user devstack@n-api.service[61512]: X-User: tempest-ServersNegativeTestJSON-1218199999-project-member Apr 21 15:40:42 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:40:42 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:40:42 user devstack@n-api.service[61512]: X-User-Id: a9c07c4b2ee5404db0ad5e5126dcdfb5 Apr 21 15:40:42 user devstack@n-api.service[61512]: X-User-Name: tempest-ServersNegativeTestJSON-1218199999-project-member Apr 21 15:40:42 user devstack@n-api.service[61512]: method: > Apr 21 15:40:42 user devstack@n-api.service[61512]: exception: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:40:42 user devstack@n-api.service[61512]: action_args: {'id': '77788e0b-c833-42c0-ba9b-3e32dce614f5'} Apr 21 15:40:42 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:40:42 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-5af9b1e2-1784-45c6-8684-dca34e153652 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Returning 404 to user: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:40:42 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-5af9b1e2-1784-45c6-8684-dca34e153652 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5" status: 404 len: 111 microversion: 2.1 time: 0.038565 Apr 21 15:40:42 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 108/326] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:40:42 2023] DELETE /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:40:42 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6c80f1a6-0902-4090-a334-e2458b84d97a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:42 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-6c80f1a6-0902-4090-a334-e2458b84d97a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: 77788e0b-c833-42c0-ba9b-3e32dce614f5] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6c80f1a6-0902-4090-a334-e2458b84d97a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6c80f1a6-0902-4090-a334-e2458b84d97a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6c80f1a6-0902-4090-a334-e2458b84d97a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6c80f1a6-0902-4090-a334-e2458b84d97a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6c80f1a6-0902-4090-a334-e2458b84d97a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:42 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-6c80f1a6-0902-4090-a334-e2458b84d97a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:42 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-6c80f1a6-0902-4090-a334-e2458b84d97a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] HTTP exception thrown: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:40:42 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6c80f1a6-0902-4090-a334-e2458b84d97a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Request method failure captured: Apr 21 15:40:42 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5 HTTP/1.1 Apr 21 15:40:42 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:40:42 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:40:42 user devstack@n-api.service[61510]: Connection: close Apr 21 15:40:42 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:40:42 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:40:42 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:40:42 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:40:42 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqxxfn6YsezSe1GwgZo3rylgS0v7jps8BtN4DLw78TQ1Hh1z_-ev4wakoV_vfH6GhiPZncaWjJ4xZ036Q1BGwprYalwXnDUVp0TiciEGlFEP1PbEKOHu1Th6o7-csDT4hBn7rG0UPUPwVAsOIIbz9TW5mkc5gxvMsdw1zA1MwPxgfKk Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Project-Id: c6a34de8879c43bcb72b8eb70df45700 Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Project-Name: tempest-ServersNegativeTestJSON-1218199999 Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6a34de8879c43bcb72b8eb70df45700"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6a34de8879c43bcb72b8eb70df45700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c6a34de8879c43bcb72b8eb70df45700"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Tenant: tempest-ServersNegativeTestJSON-1218199999 Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Tenant-Id: c6a34de8879c43bcb72b8eb70df45700 Apr 21 15:40:42 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1218199999 Apr 21 15:40:42 user devstack@n-api.service[61510]: X-User: tempest-ServersNegativeTestJSON-1218199999-project-member Apr 21 15:40:42 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:40:42 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:40:42 user devstack@n-api.service[61510]: X-User-Id: a9c07c4b2ee5404db0ad5e5126dcdfb5 Apr 21 15:40:42 user devstack@n-api.service[61510]: X-User-Name: tempest-ServersNegativeTestJSON-1218199999-project-member Apr 21 15:40:42 user devstack@n-api.service[61510]: method: > Apr 21 15:40:42 user devstack@n-api.service[61510]: exception: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:40:42 user devstack@n-api.service[61510]: action_args: {'id': '77788e0b-c833-42c0-ba9b-3e32dce614f5'} Apr 21 15:40:42 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. Apr 21 15:40:42 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:42 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-6c80f1a6-0902-4090-a334-e2458b84d97a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Returning 404 to user: Instance 77788e0b-c833-42c0-ba9b-3e32dce614f5 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:40:42 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-6c80f1a6-0902-4090-a334-e2458b84d97a tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5" status: 404 len: 111 microversion: 2.1 time: 0.030973 Apr 21 15:40:42 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 108/327] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:40:42 2023] GET /compute/v2.1/servers/77788e0b-c833-42c0-ba9b-3e32dce614f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:40:42 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-2adb309d-ce41-45ed-90f8-53f0a6386abc tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:42 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-2adb309d-ce41-45ed-90f8-53f0a6386abc tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: e948aeec-acfe-4862-8f6a-28e02c05c46c] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:42 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2adb309d-ce41-45ed-90f8-53f0a6386abc tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:42 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2adb309d-ce41-45ed-90f8-53f0a6386abc tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:42 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2adb309d-ce41-45ed-90f8-53f0a6386abc tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:42 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2adb309d-ce41-45ed-90f8-53f0a6386abc tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:42 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2adb309d-ce41-45ed-90f8-53f0a6386abc tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:42 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2adb309d-ce41-45ed-90f8-53f0a6386abc tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:42 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-2adb309d-ce41-45ed-90f8-53f0a6386abc tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: e948aeec-acfe-4862-8f6a-28e02c05c46c] Going to try to terminate instance {{(pid=61511) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:40:42 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-2adb309d-ce41-45ed-90f8-53f0a6386abc tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c" status: 204 len: 0 microversion: 2.1 time: 0.142943 Apr 21 15:40:42 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 112/328] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:40:42 2023] DELETE /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-85be2b3d-31b1-4636-9f7f-7be8eb812401 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-85be2b3d-31b1-4636-9f7f-7be8eb812401 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: e948aeec-acfe-4862-8f6a-28e02c05c46c] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-85be2b3d-31b1-4636-9f7f-7be8eb812401 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-85be2b3d-31b1-4636-9f7f-7be8eb812401 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-85be2b3d-31b1-4636-9f7f-7be8eb812401 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-85be2b3d-31b1-4636-9f7f-7be8eb812401 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-85be2b3d-31b1-4636-9f7f-7be8eb812401 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-85be2b3d-31b1-4636-9f7f-7be8eb812401 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:42 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-85be2b3d-31b1-4636-9f7f-7be8eb812401 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9c07c4b2ee5404db0ad5e5126dcdfb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a34de8879c43bcb72b8eb70df45700', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:40:42 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-85be2b3d-31b1-4636-9f7f-7be8eb812401 tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c" status: 200 len: 1499 microversion: 2.1 time: 0.319379 Apr 21 15:40:42 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 109/329] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:40:42 2023] GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c => generated 1499 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:40:43 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-41f23496-5870-4cf0-a2ff-2b83e2484d3e req-a6eeebb9-34c8-442e-82d7-347f39643f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e948aeec-acfe-4862-8f6a-28e02c05c46c", "name": "network-vif-unplugged", "status": "completed", "tag": "f3eeb5a5-1272-48ef-a96f-fe7cdc2fcbb6"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:43 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:43 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-41f23496-5870-4cf0-a2ff-2b83e2484d3e req-a6eeebb9-34c8-442e-82d7-347f39643f89 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:43 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-41f23496-5870-4cf0-a2ff-2b83e2484d3e req-a6eeebb9-34c8-442e-82d7-347f39643f89 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:43 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-41f23496-5870-4cf0-a2ff-2b83e2484d3e req-a6eeebb9-34c8-442e-82d7-347f39643f89 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:43 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-41f23496-5870-4cf0-a2ff-2b83e2484d3e req-a6eeebb9-34c8-442e-82d7-347f39643f89 service nova] Creating event network-vif-unplugged:f3eeb5a5-1272-48ef-a96f-fe7cdc2fcbb6 for instance e948aeec-acfe-4862-8f6a-28e02c05c46c on user Apr 21 15:40:43 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-41f23496-5870-4cf0-a2ff-2b83e2484d3e req-a6eeebb9-34c8-442e-82d7-347f39643f89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032037 Apr 21 15:40:43 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 109/330] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:40:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:40:44 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-e70060d0-685b-4c06-99d7-e0289420a2ad req-da426a75-8c41-4da9-bb37-2da359d8e1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e948aeec-acfe-4862-8f6a-28e02c05c46c", "name": "network-vif-deleted", "tag": "f3eeb5a5-1272-48ef-a96f-fe7cdc2fcbb6"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:44 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e70060d0-685b-4c06-99d7-e0289420a2ad req-da426a75-8c41-4da9-bb37-2da359d8e1e4 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:44 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e70060d0-685b-4c06-99d7-e0289420a2ad req-da426a75-8c41-4da9-bb37-2da359d8e1e4 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:44 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-e70060d0-685b-4c06-99d7-e0289420a2ad req-da426a75-8c41-4da9-bb37-2da359d8e1e4 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:44 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-e70060d0-685b-4c06-99d7-e0289420a2ad req-da426a75-8c41-4da9-bb37-2da359d8e1e4 service nova] Creating event network-vif-deleted:f3eeb5a5-1272-48ef-a96f-fe7cdc2fcbb6 for instance e948aeec-acfe-4862-8f6a-28e02c05c46c on user Apr 21 15:40:44 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-e70060d0-685b-4c06-99d7-e0289420a2ad req-da426a75-8c41-4da9-bb37-2da359d8e1e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034342 Apr 21 15:40:44 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 113/331] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:40:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:40:45 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-13d4e110-573b-442d-837e-21e8258ebabb req-ce32512d-d3c3-4339-9893-e97a5240f5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e948aeec-acfe-4862-8f6a-28e02c05c46c", "name": "network-vif-plugged", "status": "completed", "tag": "f3eeb5a5-1272-48ef-a96f-fe7cdc2fcbb6"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:45 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-13d4e110-573b-442d-837e-21e8258ebabb req-ce32512d-d3c3-4339-9893-e97a5240f5b5 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-13d4e110-573b-442d-837e-21e8258ebabb req-ce32512d-d3c3-4339-9893-e97a5240f5b5 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:45 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-13d4e110-573b-442d-837e-21e8258ebabb req-ce32512d-d3c3-4339-9893-e97a5240f5b5 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:45 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-13d4e110-573b-442d-837e-21e8258ebabb req-ce32512d-d3c3-4339-9893-e97a5240f5b5 service nova] Creating event network-vif-plugged:f3eeb5a5-1272-48ef-a96f-fe7cdc2fcbb6 for instance e948aeec-acfe-4862-8f6a-28e02c05c46c on user Apr 21 15:40:45 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-13d4e110-573b-442d-837e-21e8258ebabb req-ce32512d-d3c3-4339-9893-e97a5240f5b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031495 Apr 21 15:40:45 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 110/332] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:40:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c5937845-5c52-4df2-acde-43313c11ebfc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c5937845-5c52-4df2-acde-43313c11ebfc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: a2d2b868-5cc3-4349-850e-0246b1836705] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c5937845-5c52-4df2-acde-43313c11ebfc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c5937845-5c52-4df2-acde-43313c11ebfc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c5937845-5c52-4df2-acde-43313c11ebfc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c5937845-5c52-4df2-acde-43313c11ebfc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c5937845-5c52-4df2-acde-43313c11ebfc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c5937845-5c52-4df2-acde-43313c11ebfc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:46 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-c5937845-5c52-4df2-acde-43313c11ebfc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] HTTP exception thrown: Instance a2d2b868-5cc3-4349-850e-0246b1836705 could not be found. Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c5937845-5c52-4df2-acde-43313c11ebfc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Request method failure captured: Apr 21 15:40:46 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705 HTTP/1.1 Apr 21 15:40:46 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:40:46 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:40:46 user devstack@n-api.service[61510]: Connection: close Apr 21 15:40:46 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:40:46 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:40:46 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:40:46 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:40:46 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqx8v9Hl2zY9jRtYJOk1vIfUY22TEtCPbc9dahYopYaiC_kIYnV3nnJXyz8oM_1neATFYCxoUk_PmozLRRnQt4RJxGYpqApdH-QZkIK9bCNGNXORiP_wp42fwy48UwJYl-EGmfK-eqGtpcBUZ8QmtVAbuoGLE40pCQGgSvr4Yf46wFg Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Openstack-Nova-Api-Version: 2.87 Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Project-Id: 0a0f7bbaef144dd48802a9fec82525fc Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1467086537 Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a0f7bbaef144dd48802a9fec82525fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a0f7bbaef144dd48802a9fec82525fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a0f7bbaef144dd48802a9fec82525fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1467086537 Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Tenant-Id: 0a0f7bbaef144dd48802a9fec82525fc Apr 21 15:40:46 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1467086537 Apr 21 15:40:46 user devstack@n-api.service[61510]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member Apr 21 15:40:46 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:40:46 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:40:46 user devstack@n-api.service[61510]: X-User-Id: e2bcea96817e44e0b433b42e617329a1 Apr 21 15:40:46 user devstack@n-api.service[61510]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member Apr 21 15:40:46 user devstack@n-api.service[61510]: method: > Apr 21 15:40:46 user devstack@n-api.service[61510]: exception: Instance a2d2b868-5cc3-4349-850e-0246b1836705 could not be found. Apr 21 15:40:46 user devstack@n-api.service[61510]: action_args: {'id': 'a2d2b868-5cc3-4349-850e-0246b1836705'} Apr 21 15:40:46 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2d2b868-5cc3-4349-850e-0246b1836705 could not be found. Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2d2b868-5cc3-4349-850e-0246b1836705 could not be found. Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2d2b868-5cc3-4349-850e-0246b1836705 could not be found. Apr 21 15:40:46 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c5937845-5c52-4df2-acde-43313c11ebfc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Returning 404 to user: Instance a2d2b868-5cc3-4349-850e-0246b1836705 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:40:46 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c5937845-5c52-4df2-acde-43313c11ebfc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705" status: 404 len: 111 microversion: 2.87 time: 0.035320 Apr 21 15:40:46 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 110/333] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:40:46 2023] GET /compute/v2.1/servers/a2d2b868-5cc3-4349-850e-0246b1836705 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 15:40:46 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:46 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:40:46 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-475642d5-097b-4a07-ab95-dec0cbb557db tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:46 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-475642d5-097b-4a07-ab95-dec0cbb557db tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: d9cce6ca-aeb4-454a-83db-794936352483] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-475642d5-097b-4a07-ab95-dec0cbb557db tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-475642d5-097b-4a07-ab95-dec0cbb557db tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-475642d5-097b-4a07-ab95-dec0cbb557db tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-475642d5-097b-4a07-ab95-dec0cbb557db tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-475642d5-097b-4a07-ab95-dec0cbb557db tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-475642d5-097b-4a07-ab95-dec0cbb557db tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:46 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-475642d5-097b-4a07-ab95-dec0cbb557db tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: d9cce6ca-aeb4-454a-83db-794936352483] Going to try to terminate instance {{(pid=61511) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:40:46 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-475642d5-097b-4a07-ab95-dec0cbb557db tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483" status: 204 len: 0 microversion: 2.87 time: 0.140965 Apr 21 15:40:46 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 114/334] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 15:40:46 2023] DELETE /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 15:40:46 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-1b8b3027-22ce-4cbc-97c4-a965a84fafdc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:40:46 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-1b8b3027-22ce-4cbc-97c4-a965a84fafdc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: d9cce6ca-aeb4-454a-83db-794936352483] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:40:46 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1b8b3027-22ce-4cbc-97c4-a965a84fafdc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:46 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1b8b3027-22ce-4cbc-97c4-a965a84fafdc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:46 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1b8b3027-22ce-4cbc-97c4-a965a84fafdc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:46 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1b8b3027-22ce-4cbc-97c4-a965a84fafdc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:46 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1b8b3027-22ce-4cbc-97c4-a965a84fafdc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:46 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1b8b3027-22ce-4cbc-97c4-a965a84fafdc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:46 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-1b8b3027-22ce-4cbc-97c4-a965a84fafdc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:40:46 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-1b8b3027-22ce-4cbc-97c4-a965a84fafdc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:40:46 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-1b8b3027-22ce-4cbc-97c4-a965a84fafdc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2bcea96817e44e0b433b42e617329a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0f7bbaef144dd48802a9fec82525fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:40:46 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-1b8b3027-22ce-4cbc-97c4-a965a84fafdc tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483" status: 200 len: 1697 microversion: 2.87 time: 0.273036 Apr 21 15:40:46 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 111/335] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:40:46 2023] GET /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483 => generated 1697 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-a4d02780-fada-448f-b9a5-56c2e6c0b03e req-da432d48-3385-435e-8460-2449eddcefac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cce6ca-aeb4-454a-83db-794936352483", "name": "network-vif-unplugged", "status": "completed", "tag": "07ff4ab4-9f6c-4291-89f2-281307d80a70"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-a4d02780-fada-448f-b9a5-56c2e6c0b03e req-da432d48-3385-435e-8460-2449eddcefac service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-a4d02780-fada-448f-b9a5-56c2e6c0b03e req-da432d48-3385-435e-8460-2449eddcefac service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-a4d02780-fada-448f-b9a5-56c2e6c0b03e req-da432d48-3385-435e-8460-2449eddcefac service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:46 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-a4d02780-fada-448f-b9a5-56c2e6c0b03e req-da432d48-3385-435e-8460-2449eddcefac service nova] Creating event network-vif-unplugged:07ff4ab4-9f6c-4291-89f2-281307d80a70 for instance d9cce6ca-aeb4-454a-83db-794936352483 on user Apr 21 15:40:46 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-a4d02780-fada-448f-b9a5-56c2e6c0b03e req-da432d48-3385-435e-8460-2449eddcefac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028718 Apr 21 15:40:46 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 111/336] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:40:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:40:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-7eb9d7e7-2a5a-4659-9f48-88888fea6820 req-609acc9f-af90-481b-8c2b-5f044f01c88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cce6ca-aeb4-454a-83db-794936352483", "name": "network-vif-plugged", "status": "completed", "tag": "07ff4ab4-9f6c-4291-89f2-281307d80a70"}, {"server_uuid": "d9cce6ca-aeb4-454a-83db-794936352483", "name": "network-vif-deleted", "tag": "07ff4ab4-9f6c-4291-89f2-281307d80a70"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:40:49 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-7eb9d7e7-2a5a-4659-9f48-88888fea6820 req-609acc9f-af90-481b-8c2b-5f044f01c88e service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:40:49 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-7eb9d7e7-2a5a-4659-9f48-88888fea6820 req-609acc9f-af90-481b-8c2b-5f044f01c88e service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:40:49 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-7eb9d7e7-2a5a-4659-9f48-88888fea6820 req-609acc9f-af90-481b-8c2b-5f044f01c88e service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:40:49 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-7eb9d7e7-2a5a-4659-9f48-88888fea6820 req-609acc9f-af90-481b-8c2b-5f044f01c88e service nova] Creating event network-vif-plugged:07ff4ab4-9f6c-4291-89f2-281307d80a70 for instance d9cce6ca-aeb4-454a-83db-794936352483 on user Apr 21 15:40:49 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-7eb9d7e7-2a5a-4659-9f48-88888fea6820 req-609acc9f-af90-481b-8c2b-5f044f01c88e service nova] Creating event network-vif-deleted:07ff4ab4-9f6c-4291-89f2-281307d80a70 for instance d9cce6ca-aeb4-454a-83db-794936352483 on user Apr 21 15:40:49 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-7eb9d7e7-2a5a-4659-9f48-88888fea6820 req-609acc9f-af90-481b-8c2b-5f044f01c88e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077124 Apr 21 15:40:49 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 115/337] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:40:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:41:10 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-0cc7f857-77d7-4749-9b9b-eec86f50b757 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:41:10 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-0cc7f857-77d7-4749-9b9b-eec86f50b757 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:41:10 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=20 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:10 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-0cc7f857-77d7-4749-9b9b-eec86f50b757 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-0cc7f857-77d7-4749-9b9b-eec86f50b757 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-0cc7f857-77d7-4749-9b9b-eec86f50b757 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-0cc7f857-77d7-4749-9b9b-eec86f50b757 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-0cc7f857-77d7-4749-9b9b-eec86f50b757 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:10 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-0cc7f857-77d7-4749-9b9b-eec86f50b757 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:11 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-0cc7f857-77d7-4749-9b9b-eec86f50b757 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:41:11 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-0cc7f857-77d7-4749-9b9b-eec86f50b757 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1657 microversion: 2.1 time: 0.234427 Apr 21 15:41:11 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 112/338] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:41:10 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1657 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:41:13 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:13 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=16 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:13 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-0a6094ee-080c-477a-b57d-47f01222c310 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:41:13 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-0a6094ee-080c-477a-b57d-47f01222c310 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] [instance: 1570e80b-42fe-48de-a976-f821fdab5f9b] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:41:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0a6094ee-080c-477a-b57d-47f01222c310 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0a6094ee-080c-477a-b57d-47f01222c310 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0a6094ee-080c-477a-b57d-47f01222c310 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0a6094ee-080c-477a-b57d-47f01222c310 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0a6094ee-080c-477a-b57d-47f01222c310 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-0a6094ee-080c-477a-b57d-47f01222c310 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:14 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-0a6094ee-080c-477a-b57d-47f01222c310 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] HTTP exception thrown: Instance 1570e80b-42fe-48de-a976-f821fdab5f9b could not be found. Apr 21 15:41:14 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-0a6094ee-080c-477a-b57d-47f01222c310 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Request method failure captured: Apr 21 15:41:14 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b HTTP/1.1 Apr 21 15:41:14 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:41:14 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:41:14 user devstack@n-api.service[61510]: Connection: close Apr 21 15:41:14 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:41:14 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:41:14 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:41:14 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:41:14 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQq1I8gl6HwBRbxQ6iOpPOPjem8BJYI27KQKjCvu5sMtkgiPBi8DLZteqLKewKi5DuX4CrfqqG2IEXWmQDgH90gFVOeRkwXpvFNycLQAvfjdTcdImevXIiVkYxJBi1uSv2ode9VTehIL8awk-Qw5uB0ZG3YOcTW3LgZGm_QlhTZu2akQ Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Project-Id: 78462ef768874f1e96974e457bcb0198 Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Project-Name: tempest-VolumesAdminNegativeTest-834278185 Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/78462ef768874f1e96974e457bcb0198"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/78462ef768874f1e96974e457bcb0198"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/78462ef768874f1e96974e457bcb0198"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Tenant: tempest-VolumesAdminNegativeTest-834278185 Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Tenant-Id: 78462ef768874f1e96974e457bcb0198 Apr 21 15:41:14 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-834278185 Apr 21 15:41:14 user devstack@n-api.service[61510]: X-User: tempest-VolumesAdminNegativeTest-834278185-project-member Apr 21 15:41:14 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:41:14 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:41:14 user devstack@n-api.service[61510]: X-User-Id: 125905d0824740b98235b346068bdb97 Apr 21 15:41:14 user devstack@n-api.service[61510]: X-User-Name: tempest-VolumesAdminNegativeTest-834278185-project-member Apr 21 15:41:14 user devstack@n-api.service[61510]: method: > Apr 21 15:41:14 user devstack@n-api.service[61510]: exception: Instance 1570e80b-42fe-48de-a976-f821fdab5f9b could not be found. Apr 21 15:41:14 user devstack@n-api.service[61510]: action_args: {'id': '1570e80b-42fe-48de-a976-f821fdab5f9b'} Apr 21 15:41:14 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1570e80b-42fe-48de-a976-f821fdab5f9b could not be found. Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1570e80b-42fe-48de-a976-f821fdab5f9b could not be found. Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1570e80b-42fe-48de-a976-f821fdab5f9b could not be found. Apr 21 15:41:14 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:41:14 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-0a6094ee-080c-477a-b57d-47f01222c310 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Returning 404 to user: Instance 1570e80b-42fe-48de-a976-f821fdab5f9b could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:41:14 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-0a6094ee-080c-477a-b57d-47f01222c310 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b" status: 404 len: 111 microversion: 2.1 time: 0.274035 Apr 21 15:41:14 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 112/339] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:41:13 2023] GET /compute/v2.1/servers/1570e80b-42fe-48de-a976-f821fdab5f9b => generated 111 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:41:14 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:14 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:14 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-27a5a2fa-8573-4a71-b244-5d4d4f9791d0 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] Calling method '.version_select at 0x7f0c1456ea70>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:41:14 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-27a5a2fa-8573-4a71-b244-5d4d4f9791d0 tempest-VolumesAdminNegativeTest-834278185 tempest-VolumesAdminNegativeTest-834278185-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378947070" status: 202 len: 0 microversion: 2.1 time: 0.035950 Apr 21 15:41:14 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 116/340] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 15:41:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378947070 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:41:14 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-fd235027-fd45-4599-a400-3c4b8961ff00 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Action: 'create', calling method: .version_select at 0x7f0c14651870>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1139182494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM4ZyA9cRKYo4Ps4PnnaQVPMpOvZMzbknd5Ol4dXnwqpeMA14r4jCJNSZqtGVNUoNLMihBM5Piv3C0Y0/K1UfS9NuT2PEvX0I6vfSS7r0cPGBMeqZbOmzTSC0RrsYi8SA=="}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:41:14 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-fd235027-fd45-4599-a400-3c4b8961ff00 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Getting quotas for project ef6dd680ccc7482cb9f545511a721bc5. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:41:14 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-fd235027-fd45-4599-a400-3c4b8961ff00 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Getting quotas for user c6447895405c454c9c881ae0a5cf9f5b and project ef6dd680ccc7482cb9f545511a721bc5. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:41:14 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-fd235027-fd45-4599-a400-3c4b8961ff00 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.155270 Apr 21 15:41:14 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 113/341] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:41:14 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1635216135", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1139182494", "security_groups": [{"name": "tempest-secgroup-smoke-1545465912"}], "networks": [{"uuid": "69b8db26-57b1-44f3-a722-b0e490e38d7d"}]}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] validate_networks() for [('69b8db26-57b1-44f3-a722-b0e490e38d7d', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:15 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:16 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Getting quotas for project ef6dd680ccc7482cb9f545511a721bc5. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:41:16 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Getting quotas for user c6447895405c454c9c881ae0a5cf9f5b and project ef6dd680ccc7482cb9f545511a721bc5. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:41:16 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:41:16 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] [instance: 04dc176a-5a30-4595-b8a5-9e325cf274de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:41:16 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-ed433db6-db1c-4765-a5d6-ac8705e285ca tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.593238 Apr 21 15:41:16 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 113/342] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:41:15 2023] POST /compute/v2.1/servers => generated 404 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:41:16 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-1948301b-2bf8-4cb0-ac3b-f1e90ebe6679 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:41:16 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-1948301b-2bf8-4cb0-ac3b-f1e90ebe6679 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] [instance: 04dc176a-5a30-4595-b8a5-9e325cf274de] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:41:16 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-1948301b-2bf8-4cb0-ac3b-f1e90ebe6679 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6447895405c454c9c881ae0a5cf9f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6dd680ccc7482cb9f545511a721bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:41:16 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-1948301b-2bf8-4cb0-ac3b-f1e90ebe6679 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de" status: 200 len: 1257 microversion: 2.1 time: 0.088630 Apr 21 15:41:16 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 117/343] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:41:16 2023] GET /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de => generated 1257 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:41:18 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-95f43858-cacd-4c21-91e1-17ef48e9da18 req-d3a0bd33-d7fa-43b1-b583-e7b742f9adb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04dc176a-5a30-4595-b8a5-9e325cf274de", "tag": "b03b4bcd-0685-4629-b461-a56ccc0e3af5"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:41:18 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-95f43858-cacd-4c21-91e1-17ef48e9da18 req-d3a0bd33-d7fa-43b1-b583-e7b742f9adb9 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:18 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-95f43858-cacd-4c21-91e1-17ef48e9da18 req-d3a0bd33-d7fa-43b1-b583-e7b742f9adb9 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:18 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-95f43858-cacd-4c21-91e1-17ef48e9da18 req-d3a0bd33-d7fa-43b1-b583-e7b742f9adb9 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:18 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-95f43858-cacd-4c21-91e1-17ef48e9da18 req-d3a0bd33-d7fa-43b1-b583-e7b742f9adb9 service nova] Creating event network-changed:b03b4bcd-0685-4629-b461-a56ccc0e3af5 for instance 04dc176a-5a30-4595-b8a5-9e325cf274de on user Apr 21 15:41:18 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-95f43858-cacd-4c21-91e1-17ef48e9da18 req-d3a0bd33-d7fa-43b1-b583-e7b742f9adb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032446 Apr 21 15:41:18 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 114/344] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:41:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:41:20 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-2fb2d422-4954-4960-a4c1-7629eeb2c40b req-4eabcb17-42dd-409e-b2a2-80ec1bc29b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04dc176a-5a30-4595-b8a5-9e325cf274de", "name": "network-vif-plugged", "status": "completed", "tag": "b03b4bcd-0685-4629-b461-a56ccc0e3af5"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:41:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-2fb2d422-4954-4960-a4c1-7629eeb2c40b req-4eabcb17-42dd-409e-b2a2-80ec1bc29b8f service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-2fb2d422-4954-4960-a4c1-7629eeb2c40b req-4eabcb17-42dd-409e-b2a2-80ec1bc29b8f service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-2fb2d422-4954-4960-a4c1-7629eeb2c40b req-4eabcb17-42dd-409e-b2a2-80ec1bc29b8f service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:20 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-2fb2d422-4954-4960-a4c1-7629eeb2c40b req-4eabcb17-42dd-409e-b2a2-80ec1bc29b8f service nova] Creating event network-vif-plugged:b03b4bcd-0685-4629-b461-a56ccc0e3af5 for instance 04dc176a-5a30-4595-b8a5-9e325cf274de on user Apr 21 15:41:20 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-2fb2d422-4954-4960-a4c1-7629eeb2c40b req-4eabcb17-42dd-409e-b2a2-80ec1bc29b8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042797 Apr 21 15:41:20 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 114/345] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:41:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:41:23 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-d18eed52-0f6a-46d0-8745-6c6d101160e0 req-35ee3053-dd91-4951-860f-687c53f1651f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04dc176a-5a30-4595-b8a5-9e325cf274de", "name": "network-vif-plugged", "status": "completed", "tag": "b03b4bcd-0685-4629-b461-a56ccc0e3af5"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:41:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-d18eed52-0f6a-46d0-8745-6c6d101160e0 req-35ee3053-dd91-4951-860f-687c53f1651f service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-d18eed52-0f6a-46d0-8745-6c6d101160e0 req-35ee3053-dd91-4951-860f-687c53f1651f service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-d18eed52-0f6a-46d0-8745-6c6d101160e0 req-35ee3053-dd91-4951-860f-687c53f1651f service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:23 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-d18eed52-0f6a-46d0-8745-6c6d101160e0 req-35ee3053-dd91-4951-860f-687c53f1651f service nova] Creating event network-vif-plugged:b03b4bcd-0685-4629-b461-a56ccc0e3af5 for instance 04dc176a-5a30-4595-b8a5-9e325cf274de on user Apr 21 15:41:23 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-d18eed52-0f6a-46d0-8745-6c6d101160e0 req-35ee3053-dd91-4951-860f-687c53f1651f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036584 Apr 21 15:41:23 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 118/346] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:41:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:41:25 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:25 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-6ac7e729-81b0-4c75-b1a7-8b6d590ab0f4 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:41:25 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-6ac7e729-81b0-4c75-b1a7-8b6d590ab0f4 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: 56c19929-6499-43ec-8b35-9edef57a737d] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:41:25 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6ac7e729-81b0-4c75-b1a7-8b6d590ab0f4 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:25 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6ac7e729-81b0-4c75-b1a7-8b6d590ab0f4 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:25 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6ac7e729-81b0-4c75-b1a7-8b6d590ab0f4 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:25 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6ac7e729-81b0-4c75-b1a7-8b6d590ab0f4 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:25 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6ac7e729-81b0-4c75-b1a7-8b6d590ab0f4 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:25 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6ac7e729-81b0-4c75-b1a7-8b6d590ab0f4 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:25 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-6ac7e729-81b0-4c75-b1a7-8b6d590ab0f4 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:41:25 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-6ac7e729-81b0-4c75-b1a7-8b6d590ab0f4 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:41:25 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-6ac7e729-81b0-4c75-b1a7-8b6d590ab0f4 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:41:25 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-6ac7e729-81b0-4c75-b1a7-8b6d590ab0f4 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d" status: 200 len: 1588 microversion: 2.20 time: 0.252831 Apr 21 15:41:25 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 115/347] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:41:25 2023] GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d => generated 1588 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-328d144a-298a-4877-ad7a-641e4dc6f40f tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-328d144a-298a-4877-ad7a-641e4dc6f40f tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] [instance: e948aeec-acfe-4862-8f6a-28e02c05c46c] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-328d144a-298a-4877-ad7a-641e4dc6f40f tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-328d144a-298a-4877-ad7a-641e4dc6f40f tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-328d144a-298a-4877-ad7a-641e4dc6f40f tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-328d144a-298a-4877-ad7a-641e4dc6f40f tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-328d144a-298a-4877-ad7a-641e4dc6f40f tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-328d144a-298a-4877-ad7a-641e4dc6f40f tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:33 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-328d144a-298a-4877-ad7a-641e4dc6f40f tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] HTTP exception thrown: Instance e948aeec-acfe-4862-8f6a-28e02c05c46c could not be found. Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-328d144a-298a-4877-ad7a-641e4dc6f40f tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Request method failure captured: Apr 21 15:41:33 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c HTTP/1.1 Apr 21 15:41:33 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:41:33 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:41:33 user devstack@n-api.service[61510]: Connection: close Apr 21 15:41:33 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:41:33 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:41:33 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:41:33 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:41:33 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQqxxfn6YsezSe1GwgZo3rylgS0v7jps8BtN4DLw78TQ1Hh1z_-ev4wakoV_vfH6GhiPZncaWjJ4xZ036Q1BGwprYalwXnDUVp0TiciEGlFEP1PbEKOHu1Th6o7-csDT4hBn7rG0UPUPwVAsOIIbz9TW5mkc5gxvMsdw1zA1MwPxgfKk Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Project-Id: c6a34de8879c43bcb72b8eb70df45700 Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Project-Name: tempest-ServersNegativeTestJSON-1218199999 Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6a34de8879c43bcb72b8eb70df45700"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6a34de8879c43bcb72b8eb70df45700"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c6a34de8879c43bcb72b8eb70df45700"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Tenant: tempest-ServersNegativeTestJSON-1218199999 Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Tenant-Id: c6a34de8879c43bcb72b8eb70df45700 Apr 21 15:41:33 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1218199999 Apr 21 15:41:33 user devstack@n-api.service[61510]: X-User: tempest-ServersNegativeTestJSON-1218199999-project-member Apr 21 15:41:33 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:41:33 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:41:33 user devstack@n-api.service[61510]: X-User-Id: a9c07c4b2ee5404db0ad5e5126dcdfb5 Apr 21 15:41:33 user devstack@n-api.service[61510]: X-User-Name: tempest-ServersNegativeTestJSON-1218199999-project-member Apr 21 15:41:33 user devstack@n-api.service[61510]: method: > Apr 21 15:41:33 user devstack@n-api.service[61510]: exception: Instance e948aeec-acfe-4862-8f6a-28e02c05c46c could not be found. Apr 21 15:41:33 user devstack@n-api.service[61510]: action_args: {'id': 'e948aeec-acfe-4862-8f6a-28e02c05c46c'} Apr 21 15:41:33 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e948aeec-acfe-4862-8f6a-28e02c05c46c could not be found. Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e948aeec-acfe-4862-8f6a-28e02c05c46c could not be found. Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e948aeec-acfe-4862-8f6a-28e02c05c46c could not be found. Apr 21 15:41:33 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:41:33 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-328d144a-298a-4877-ad7a-641e4dc6f40f tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] Returning 404 to user: Instance e948aeec-acfe-4862-8f6a-28e02c05c46c could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:41:33 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-328d144a-298a-4877-ad7a-641e4dc6f40f tempest-ServersNegativeTestJSON-1218199999 tempest-ServersNegativeTestJSON-1218199999-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c" status: 404 len: 111 microversion: 2.1 time: 0.042064 Apr 21 15:41:33 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 115/348] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:41:33 2023] GET /compute/v2.1/servers/e948aeec-acfe-4862-8f6a-28e02c05c46c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-859ef60c-7a6d-479e-a7e1-e33605e7b831 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-859ef60c-7a6d-479e-a7e1-e33605e7b831 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] [instance: d9cce6ca-aeb4-454a-83db-794936352483] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-859ef60c-7a6d-479e-a7e1-e33605e7b831 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-859ef60c-7a6d-479e-a7e1-e33605e7b831 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-859ef60c-7a6d-479e-a7e1-e33605e7b831 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-859ef60c-7a6d-479e-a7e1-e33605e7b831 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-859ef60c-7a6d-479e-a7e1-e33605e7b831 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-859ef60c-7a6d-479e-a7e1-e33605e7b831 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:36 user devstack@n-api.service[61511]: INFO nova.api.openstack.wsgi [None req-859ef60c-7a6d-479e-a7e1-e33605e7b831 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] HTTP exception thrown: Instance d9cce6ca-aeb4-454a-83db-794936352483 could not be found. Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-859ef60c-7a6d-479e-a7e1-e33605e7b831 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Request method failure captured: Apr 21 15:41:36 user devstack@n-api.service[61511]: request: GET /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483 HTTP/1.1 Apr 21 15:41:36 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:41:36 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:41:36 user devstack@n-api.service[61511]: Connection: close Apr 21 15:41:36 user devstack@n-api.service[61511]: Content-Length: 0 Apr 21 15:41:36 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:41:36 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:41:36 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:41:36 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQqx8v9Hl2zY9jRtYJOk1vIfUY22TEtCPbc9dahYopYaiC_kIYnV3nnJXyz8oM_1neATFYCxoUk_PmozLRRnQt4RJxGYpqApdH-QZkIK9bCNGNXORiP_wp42fwy48UwJYl-EGmfK-eqGtpcBUZ8QmtVAbuoGLE40pCQGgSvr4Yf46wFg Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Openstack-Nova-Api-Version: 2.87 Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Project-Id: 0a0f7bbaef144dd48802a9fec82525fc Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1467086537 Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a0f7bbaef144dd48802a9fec82525fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a0f7bbaef144dd48802a9fec82525fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a0f7bbaef144dd48802a9fec82525fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1467086537 Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Tenant-Id: 0a0f7bbaef144dd48802a9fec82525fc Apr 21 15:41:36 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1467086537 Apr 21 15:41:36 user devstack@n-api.service[61511]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member Apr 21 15:41:36 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:41:36 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:41:36 user devstack@n-api.service[61511]: X-User-Id: e2bcea96817e44e0b433b42e617329a1 Apr 21 15:41:36 user devstack@n-api.service[61511]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member Apr 21 15:41:36 user devstack@n-api.service[61511]: method: > Apr 21 15:41:36 user devstack@n-api.service[61511]: exception: Instance d9cce6ca-aeb4-454a-83db-794936352483 could not be found. Apr 21 15:41:36 user devstack@n-api.service[61511]: action_args: {'id': 'd9cce6ca-aeb4-454a-83db-794936352483'} Apr 21 15:41:36 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9cce6ca-aeb4-454a-83db-794936352483 could not be found. Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9cce6ca-aeb4-454a-83db-794936352483 could not be found. Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9cce6ca-aeb4-454a-83db-794936352483 could not be found. Apr 21 15:41:36 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:41:36 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-859ef60c-7a6d-479e-a7e1-e33605e7b831 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] Returning 404 to user: Instance d9cce6ca-aeb4-454a-83db-794936352483 could not be found. {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:41:36 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-859ef60c-7a6d-479e-a7e1-e33605e7b831 tempest-ServerBootFromVolumeStableRescueTest-1467086537 tempest-ServerBootFromVolumeStableRescueTest-1467086537-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483" status: 404 len: 111 microversion: 2.87 time: 0.054099 Apr 21 15:41:36 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 119/349] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:41:36 2023] GET /compute/v2.1/servers/d9cce6ca-aeb4-454a-83db-794936352483 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 15:41:47 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:47 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=14 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:47 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-715d2727-e8be-481d-aeb2-fa270d3ae74f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Action: 'create', calling method: .version_select at 0x7f0c146b71c0>, body: {"keypair": {"name": "tempest-keypair-387472105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErqlCMrUZq7Jk+k94r7FqHMSDcgw6aGzFNRDZL9Cj6YimJfxiloPQZ6wp9SkMCcu4REiK9Kj0yQYSBPDiSg1xmih6tegLw95wCsGngQo8fPWaslhbRl1m/MO72b9Qdzuw=="}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:41:47 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-715d2727-e8be-481d-aeb2-fa270d3ae74f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Getting quotas for project c72ad1c36d144329b11fa1284f3bfd67. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:41:47 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-715d2727-e8be-481d-aeb2-fa270d3ae74f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Getting quotas for user aecd98fdee134e4c82e721ee37b67553 and project c72ad1c36d144329b11fa1284f3bfd67. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:41:47 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-715d2727-e8be-481d-aeb2-fa270d3ae74f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.203530 Apr 21 15:41:47 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 116/350] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:41:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-847481509", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7b830168-2361-4af6-82ae-921e5cb3670f"}], "security_groups": [{"name": "tempest-securitygroup--582715396"}], "key_name": "tempest-keypair-387472105", "user_data": "}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG nova.network.neutron [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] validate_networks() for [('7b830168-2361-4af6-82ae-921e5cb3670f', None, None, None, None, None)] {{(pid=61510) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Flavor limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Image limits 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Flavor pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Image pref 0:0:0 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG nova.virt.hardware [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Getting quotas for project c72ad1c36d144329b11fa1284f3bfd67. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Getting quotas for user aecd98fdee134e4c82e721ee37b67553 and project c72ad1c36d144329b11fa1284f3bfd67. Resources: {'ram', 'cores', 'instances'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Going to run 1 instances... {{(pid=61510) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:41:49 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 6aee29af-024c-4e5c-a893-87af63214df3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:41:49 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-129dd4fe-4253-4b7b-a6d5-8a63764dd5db tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.660974 Apr 21 15:41:49 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 116/351] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:41:49 2023] POST /compute/v2.1/servers => generated 399 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:41:49 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-be25bedc-d6ce-4ad8-a5da-5bd03e10776a tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:41:49 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-be25bedc-d6ce-4ad8-a5da-5bd03e10776a tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 6aee29af-024c-4e5c-a893-87af63214df3] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:41:49 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:49 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:41:49 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-be25bedc-d6ce-4ad8-a5da-5bd03e10776a tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecd98fdee134e4c82e721ee37b67553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72ad1c36d144329b11fa1284f3bfd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:41:49 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-be25bedc-d6ce-4ad8-a5da-5bd03e10776a tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3" status: 200 len: 1230 microversion: 2.1 time: 0.080098 Apr 21 15:41:49 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 120/352] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:41:49 2023] GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3 => generated 1230 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:41:52 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-b9178dca-d224-467c-b0e2-df2fcc2ad23c req-2eab38fa-05fa-47b0-9b25-64023ea3a393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aee29af-024c-4e5c-a893-87af63214df3", "tag": "8615b97c-5299-439d-a60d-9e831d0910f8"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:41:52 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-b9178dca-d224-467c-b0e2-df2fcc2ad23c req-2eab38fa-05fa-47b0-9b25-64023ea3a393 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:52 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-b9178dca-d224-467c-b0e2-df2fcc2ad23c req-2eab38fa-05fa-47b0-9b25-64023ea3a393 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:52 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-b9178dca-d224-467c-b0e2-df2fcc2ad23c req-2eab38fa-05fa-47b0-9b25-64023ea3a393 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:52 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-b9178dca-d224-467c-b0e2-df2fcc2ad23c req-2eab38fa-05fa-47b0-9b25-64023ea3a393 service nova] Creating event network-changed:8615b97c-5299-439d-a60d-9e831d0910f8 for instance 6aee29af-024c-4e5c-a893-87af63214df3 on user Apr 21 15:41:52 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-b9178dca-d224-467c-b0e2-df2fcc2ad23c req-2eab38fa-05fa-47b0-9b25-64023ea3a393 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037761 Apr 21 15:41:52 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 117/353] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:41:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:41:54 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-202efb26-fb05-4b23-8e3c-7ef6ba1d4c6c req-dd41b041-3949-42b0-9d6c-7e11484794d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aee29af-024c-4e5c-a893-87af63214df3", "name": "network-vif-plugged", "status": "completed", "tag": "8615b97c-5299-439d-a60d-9e831d0910f8"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:41:54 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-202efb26-fb05-4b23-8e3c-7ef6ba1d4c6c req-dd41b041-3949-42b0-9d6c-7e11484794d8 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:54 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-202efb26-fb05-4b23-8e3c-7ef6ba1d4c6c req-dd41b041-3949-42b0-9d6c-7e11484794d8 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:54 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-202efb26-fb05-4b23-8e3c-7ef6ba1d4c6c req-dd41b041-3949-42b0-9d6c-7e11484794d8 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:54 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-202efb26-fb05-4b23-8e3c-7ef6ba1d4c6c req-dd41b041-3949-42b0-9d6c-7e11484794d8 service nova] Creating event network-vif-plugged:8615b97c-5299-439d-a60d-9e831d0910f8 for instance 6aee29af-024c-4e5c-a893-87af63214df3 on user Apr 21 15:41:54 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-202efb26-fb05-4b23-8e3c-7ef6ba1d4c6c req-dd41b041-3949-42b0-9d6c-7e11484794d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030435 Apr 21 15:41:54 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 117/354] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:41:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:41:56 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-938069b0-46b6-4c30-a239-c95347fd441a req-1a93093f-db9c-424f-82e4-a716cd2526da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aee29af-024c-4e5c-a893-87af63214df3", "name": "network-vif-plugged", "status": "completed", "tag": "8615b97c-5299-439d-a60d-9e831d0910f8"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:41:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-938069b0-46b6-4c30-a239-c95347fd441a req-1a93093f-db9c-424f-82e4-a716cd2526da service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:41:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-938069b0-46b6-4c30-a239-c95347fd441a req-1a93093f-db9c-424f-82e4-a716cd2526da service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:41:56 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-938069b0-46b6-4c30-a239-c95347fd441a req-1a93093f-db9c-424f-82e4-a716cd2526da service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:41:56 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-938069b0-46b6-4c30-a239-c95347fd441a req-1a93093f-db9c-424f-82e4-a716cd2526da service nova] Creating event network-vif-plugged:8615b97c-5299-439d-a60d-9e831d0910f8 for instance 6aee29af-024c-4e5c-a893-87af63214df3 on user Apr 21 15:41:56 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-938069b0-46b6-4c30-a239-c95347fd441a req-1a93093f-db9c-424f-82e4-a716cd2526da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037278 Apr 21 15:41:56 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 121/355] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:41:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:42:02 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:02 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:02 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:03 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-07f1bbd4-dd3a-41fa-841b-4d72b36dbf18 tempest-TestStampPattern-997095064 tempest-TestStampPattern-997095064-project-member] Action: 'create', calling method: .version_select at 0x7f0c146b5bd0>, body: {"keypair": {"name": "tempest-TestStampPattern-1765636315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh1EwbpqOrlP/g1ywsxCDHWntbe5uJ69FQFciLDl/T+Cek0KfO6aw0IfV9EcLZ0J4Gb34X4IqJ3tyy4Q5fo6p+bTRnLBMGj0OW63kBy1mhaYt3vXJQORyvEwURUX9tfAQ=="}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:42:03 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-07f1bbd4-dd3a-41fa-841b-4d72b36dbf18 tempest-TestStampPattern-997095064 tempest-TestStampPattern-997095064-project-member] Getting quotas for project cad558bcc40e4b36839a7b3c49c82059. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:42:03 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-07f1bbd4-dd3a-41fa-841b-4d72b36dbf18 tempest-TestStampPattern-997095064 tempest-TestStampPattern-997095064-project-member] Getting quotas for user 58c49edbe2154272a365fd9c07c2d0ad and project cad558bcc40e4b36839a7b3c49c82059. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:42:03 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-07f1bbd4-dd3a-41fa-841b-4d72b36dbf18 tempest-TestStampPattern-997095064 tempest-TestStampPattern-997095064-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.231997 Apr 21 15:42:03 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 118/356] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:42:02 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=2 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-770454d7-1854-48ee-abd0-12a73356577b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-770454d7-1854-48ee-abd0-12a73356577b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] [instance: 04dc176a-5a30-4595-b8a5-9e325cf274de] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-770454d7-1854-48ee-abd0-12a73356577b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-770454d7-1854-48ee-abd0-12a73356577b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-770454d7-1854-48ee-abd0-12a73356577b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-770454d7-1854-48ee-abd0-12a73356577b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-770454d7-1854-48ee-abd0-12a73356577b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-770454d7-1854-48ee-abd0-12a73356577b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:06 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:06 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:06 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:06 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-aee490d4-450a-47ce-a764-c6d76a855edf tempest-TestStampPattern-997095064 tempest-TestStampPattern-997095064-project-member] Calling method '.version_select at 0x7f0c1456f640>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:42:06 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-aee490d4-450a-47ce-a764-c6d76a855edf tempest-TestStampPattern-997095064 tempest-TestStampPattern-997095064-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1765636315" status: 202 len: 0 microversion: 2.1 time: 0.027014 Apr 21 15:42:06 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 122/357] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 15:42:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1765636315 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:42:06 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-770454d7-1854-48ee-abd0-12a73356577b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6447895405c454c9c881ae0a5cf9f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6dd680ccc7482cb9f545511a721bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:42:06 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-770454d7-1854-48ee-abd0-12a73356577b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de" status: 200 len: 1570 microversion: 2.1 time: 0.495569 Apr 21 15:42:06 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 118/358] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:42:06 2023] GET /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de => generated 1570 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:42:11 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-3e638ede-1669-4a4c-8424-b26ef20ff028 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:42:11 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-3e638ede-1669-4a4c-8424-b26ef20ff028 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:42:11 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3e638ede-1669-4a4c-8424-b26ef20ff028 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:11 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3e638ede-1669-4a4c-8424-b26ef20ff028 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:11 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3e638ede-1669-4a4c-8424-b26ef20ff028 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:11 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3e638ede-1669-4a4c-8424-b26ef20ff028 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:11 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3e638ede-1669-4a4c-8424-b26ef20ff028 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:11 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-3e638ede-1669-4a4c-8424-b26ef20ff028 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:11 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-3e638ede-1669-4a4c-8424-b26ef20ff028 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Going to try to terminate instance {{(pid=61512) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:42:11 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-3e638ede-1669-4a4c-8424-b26ef20ff028 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 204 len: 0 microversion: 2.1 time: 0.171972 Apr 21 15:42:11 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 119/359] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:42:11 2023] DELETE /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:42:11 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-65c74725-1e8b-4993-816e-f44965df8500 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:42:11 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-65c74725-1e8b-4993-816e-f44965df8500 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:42:11 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-65c74725-1e8b-4993-816e-f44965df8500 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:11 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-65c74725-1e8b-4993-816e-f44965df8500 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:11 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-65c74725-1e8b-4993-816e-f44965df8500 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:11 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-65c74725-1e8b-4993-816e-f44965df8500 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:11 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-65c74725-1e8b-4993-816e-f44965df8500 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:11 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-65c74725-1e8b-4993-816e-f44965df8500 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:11 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-5191785b-7f61-4f3b-a1b9-7ac961078cf7 req-ea775694-c95f-412b-8d9f-df61aca640a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6e1f23-e822-4a09-81f3-7e20ba206859", "name": "network-vif-unplugged", "status": "completed", "tag": "323ad3b5-ae92-4ce7-856c-e9d50ba56c97"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:42:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-5191785b-7f61-4f3b-a1b9-7ac961078cf7 req-ea775694-c95f-412b-8d9f-df61aca640a0 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-5191785b-7f61-4f3b-a1b9-7ac961078cf7 req-ea775694-c95f-412b-8d9f-df61aca640a0 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-5191785b-7f61-4f3b-a1b9-7ac961078cf7 req-ea775694-c95f-412b-8d9f-df61aca640a0 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:11 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-5191785b-7f61-4f3b-a1b9-7ac961078cf7 req-ea775694-c95f-412b-8d9f-df61aca640a0 service nova] Creating event network-vif-unplugged:323ad3b5-ae92-4ce7-856c-e9d50ba56c97 for instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 on user Apr 21 15:42:11 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-5191785b-7f61-4f3b-a1b9-7ac961078cf7 req-ea775694-c95f-412b-8d9f-df61aca640a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041986 Apr 21 15:42:11 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 119/360] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:42:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:42:12 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-65c74725-1e8b-4993-816e-f44965df8500 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0bf3ef5fa614461b212054b7b9cd479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646a4c1a69b34d6d99324c082d74efcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:42:12 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-65c74725-1e8b-4993-816e-f44965df8500 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 200 len: 1663 microversion: 2.1 time: 0.452056 Apr 21 15:42:12 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 123/361] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:42:11 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 1663 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:42:13 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-f5e2df16-2bdb-4118-aa4a-6eb3570daa92 req-2e8a1871-a55e-4e64-9d7b-d4ca83573486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6e1f23-e822-4a09-81f3-7e20ba206859", "name": "network-vif-deleted", "tag": "323ad3b5-ae92-4ce7-856c-e9d50ba56c97"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:42:13 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:13 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-f5e2df16-2bdb-4118-aa4a-6eb3570daa92 req-2e8a1871-a55e-4e64-9d7b-d4ca83573486 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:13 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-f5e2df16-2bdb-4118-aa4a-6eb3570daa92 req-2e8a1871-a55e-4e64-9d7b-d4ca83573486 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:13 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-f5e2df16-2bdb-4118-aa4a-6eb3570daa92 req-2e8a1871-a55e-4e64-9d7b-d4ca83573486 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:13 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-f5e2df16-2bdb-4118-aa4a-6eb3570daa92 req-2e8a1871-a55e-4e64-9d7b-d4ca83573486 service nova] Creating event network-vif-deleted:323ad3b5-ae92-4ce7-856c-e9d50ba56c97 for instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 on user Apr 21 15:42:13 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-f5e2df16-2bdb-4118-aa4a-6eb3570daa92 req-2e8a1871-a55e-4e64-9d7b-d4ca83573486 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089097 Apr 21 15:42:13 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 120/362] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:42:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:42:13 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-d92781af-c121-4a64-a67c-7965de014a87 req-c3a5bc84-6ac1-4ba9-bbd2-f12f3fee4f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6e1f23-e822-4a09-81f3-7e20ba206859", "name": "network-vif-plugged", "status": "completed", "tag": "323ad3b5-ae92-4ce7-856c-e9d50ba56c97"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:42:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d92781af-c121-4a64-a67c-7965de014a87 req-c3a5bc84-6ac1-4ba9-bbd2-f12f3fee4f27 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d92781af-c121-4a64-a67c-7965de014a87 req-c3a5bc84-6ac1-4ba9-bbd2-f12f3fee4f27 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:14 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d92781af-c121-4a64-a67c-7965de014a87 req-c3a5bc84-6ac1-4ba9-bbd2-f12f3fee4f27 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:14 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-d92781af-c121-4a64-a67c-7965de014a87 req-c3a5bc84-6ac1-4ba9-bbd2-f12f3fee4f27 service nova] Creating event network-vif-plugged:323ad3b5-ae92-4ce7-856c-e9d50ba56c97 for instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 on user Apr 21 15:42:14 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-d92781af-c121-4a64-a67c-7965de014a87 req-c3a5bc84-6ac1-4ba9-bbd2-f12f3fee4f27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031117 Apr 21 15:42:14 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 120/363] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:42:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:42:15 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-4cb257fe-c45a-4a33-8ccc-261cf9977dcc tempest-TestVolumeBootPattern-1738108647 tempest-TestVolumeBootPattern-1738108647-project-member] Action: 'create', calling method: .version_select at 0x7f0c14536e60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1419095259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZKsR1Wi8V0vrTPbAeozZ32QyV4IQTDAl1FmYYY+GikDmdhQTlgkOSTAv1SFLtjChCUh0YSr5HQX0hnCexg8oSTCDodDgIjWyox2PPFLcfUtuaXYoYQPiUtT0na+HbPdg=="}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:42:15 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-4cb257fe-c45a-4a33-8ccc-261cf9977dcc tempest-TestVolumeBootPattern-1738108647 tempest-TestVolumeBootPattern-1738108647-project-member] Getting quotas for project 96b15023d9444b54aadbf264bced431e. Resources: {'key_pairs'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:42:15 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-4cb257fe-c45a-4a33-8ccc-261cf9977dcc tempest-TestVolumeBootPattern-1738108647 tempest-TestVolumeBootPattern-1738108647-project-member] Getting quotas for user ec9aad55049c43469fb5e2f7d9de79db and project 96b15023d9444b54aadbf264bced431e. Resources: {'key_pairs'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:42:15 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-4cb257fe-c45a-4a33-8ccc-261cf9977dcc tempest-TestVolumeBootPattern-1738108647 tempest-TestVolumeBootPattern-1738108647-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.050319 Apr 21 15:42:15 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 124/364] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:42:15 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:42:18 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-1b52a16f-83a9-420f-99ac-cc188f8b5247 tempest-TestVolumeBootPattern-1738108647 tempest-TestVolumeBootPattern-1738108647-project-member] Calling method '.version_select at 0x7f0c146b4310>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:42:18 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-1b52a16f-83a9-420f-99ac-cc188f8b5247 tempest-TestVolumeBootPattern-1738108647 tempest-TestVolumeBootPattern-1738108647-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1419095259" status: 202 len: 0 microversion: 2.1 time: 0.027479 Apr 21 15:42:18 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 121/365] 10.0.0.210 () {62 vars in 1340 bytes} [Fri Apr 21 15:42:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1419095259 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:42:25 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-ca029a16-61fb-42e7-b899-f1f283d1b8f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:42:25 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-ca029a16-61fb-42e7-b899-f1f283d1b8f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: 56c19929-6499-43ec-8b35-9edef57a737d] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:42:25 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:25 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=10 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ca029a16-61fb-42e7-b899-f1f283d1b8f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ca029a16-61fb-42e7-b899-f1f283d1b8f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ca029a16-61fb-42e7-b899-f1f283d1b8f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ca029a16-61fb-42e7-b899-f1f283d1b8f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ca029a16-61fb-42e7-b899-f1f283d1b8f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-ca029a16-61fb-42e7-b899-f1f283d1b8f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-ca029a16-61fb-42e7-b899-f1f283d1b8f8 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.204440 Apr 21 15:42:25 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 121/366] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 21 15:42:25 2023] GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d/os-interface => generated 283 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:42:26 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:26 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=4 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:26 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:26 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-6d45fa7d-d7f0-42d5-8703-e3f296364f3d req-fa673e3f-675e-4a24-9c29-5c1f8f915320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c19929-6499-43ec-8b35-9edef57a737d", "tag": "3d034010-bd19-48b6-be03-cf18de52fc64"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:42:26 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-6d45fa7d-d7f0-42d5-8703-e3f296364f3d req-fa673e3f-675e-4a24-9c29-5c1f8f915320 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:26 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-6d45fa7d-d7f0-42d5-8703-e3f296364f3d req-fa673e3f-675e-4a24-9c29-5c1f8f915320 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:26 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-6d45fa7d-d7f0-42d5-8703-e3f296364f3d req-fa673e3f-675e-4a24-9c29-5c1f8f915320 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:26 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-6d45fa7d-d7f0-42d5-8703-e3f296364f3d req-fa673e3f-675e-4a24-9c29-5c1f8f915320 service nova] Creating event network-changed:3d034010-bd19-48b6-be03-cf18de52fc64 for instance 56c19929-6499-43ec-8b35-9edef57a737d on user Apr 21 15:42:26 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-6d45fa7d-d7f0-42d5-8703-e3f296364f3d req-fa673e3f-675e-4a24-9c29-5c1f8f915320 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037411 Apr 21 15:42:26 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 125/367] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:42:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 15:42:26 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:26 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-aaa945a3-f562-42ae-8265-fba8106e7cc1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:42:26 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-aaa945a3-f562-42ae-8265-fba8106e7cc1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: 56c19929-6499-43ec-8b35-9edef57a737d] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:42:26 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-aaa945a3-f562-42ae-8265-fba8106e7cc1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:26 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-aaa945a3-f562-42ae-8265-fba8106e7cc1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:26 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-aaa945a3-f562-42ae-8265-fba8106e7cc1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:26 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-aaa945a3-f562-42ae-8265-fba8106e7cc1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:26 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-aaa945a3-f562-42ae-8265-fba8106e7cc1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:26 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-aaa945a3-f562-42ae-8265-fba8106e7cc1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:26 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-aaa945a3-f562-42ae-8265-fba8106e7cc1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d/ips" status: 200 len: 111 microversion: 2.20 time: 0.048761 Apr 21 15:42:26 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 122/368] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 21 15:42:26 2023] GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d/ips => generated 111 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 21 15:42:27 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-f0ecddf2-fa6e-4fc5-80e6-3036d5e2a722 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:42:27 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f0ecddf2-fa6e-4fc5-80e6-3036d5e2a722 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: 56c19929-6499-43ec-8b35-9edef57a737d] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:42:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f0ecddf2-fa6e-4fc5-80e6-3036d5e2a722 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f0ecddf2-fa6e-4fc5-80e6-3036d5e2a722 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f0ecddf2-fa6e-4fc5-80e6-3036d5e2a722 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f0ecddf2-fa6e-4fc5-80e6-3036d5e2a722 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f0ecddf2-fa6e-4fc5-80e6-3036d5e2a722 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-f0ecddf2-fa6e-4fc5-80e6-3036d5e2a722 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:27 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-f0ecddf2-fa6e-4fc5-80e6-3036d5e2a722 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: 56c19929-6499-43ec-8b35-9edef57a737d] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:42:27 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-f0ecddf2-fa6e-4fc5-80e6-3036d5e2a722 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d" status: 204 len: 0 microversion: 2.20 time: 0.124501 Apr 21 15:42:27 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 122/369] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 15:42:27 2023] DELETE /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 15:42:27 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-dab87cc8-f7cb-4b71-a8c0-6217cbf193a1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:42:27 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-dab87cc8-f7cb-4b71-a8c0-6217cbf193a1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: 56c19929-6499-43ec-8b35-9edef57a737d] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:42:27 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dab87cc8-f7cb-4b71-a8c0-6217cbf193a1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:27 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dab87cc8-f7cb-4b71-a8c0-6217cbf193a1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:27 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dab87cc8-f7cb-4b71-a8c0-6217cbf193a1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:27 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dab87cc8-f7cb-4b71-a8c0-6217cbf193a1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:27 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dab87cc8-f7cb-4b71-a8c0-6217cbf193a1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:27 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-dab87cc8-f7cb-4b71-a8c0-6217cbf193a1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:28 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-dab87cc8-f7cb-4b71-a8c0-6217cbf193a1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:42:28 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-dab87cc8-f7cb-4b71-a8c0-6217cbf193a1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:42:28 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-dab87cc8-f7cb-4b71-a8c0-6217cbf193a1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01e796b65ab8485ca455f943b3ec2808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fd0ca20473c4272858416eec21729af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:42:28 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-dab87cc8-f7cb-4b71-a8c0-6217cbf193a1 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d" status: 200 len: 1713 microversion: 2.20 time: 0.257986 Apr 21 15:42:28 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 126/370] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:42:27 2023] GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d => generated 1713 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 21 15:42:28 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-ac7faa57-74f6-4909-8ecd-21241fb5ebfc req-d470e71d-0f67-456a-954b-291ca66ee375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c19929-6499-43ec-8b35-9edef57a737d", "name": "network-vif-unplugged", "status": "completed", "tag": "3d034010-bd19-48b6-be03-cf18de52fc64"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:42:28 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-ac7faa57-74f6-4909-8ecd-21241fb5ebfc req-d470e71d-0f67-456a-954b-291ca66ee375 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:28 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-ac7faa57-74f6-4909-8ecd-21241fb5ebfc req-d470e71d-0f67-456a-954b-291ca66ee375 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:28 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-ac7faa57-74f6-4909-8ecd-21241fb5ebfc req-d470e71d-0f67-456a-954b-291ca66ee375 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:28 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-ac7faa57-74f6-4909-8ecd-21241fb5ebfc req-d470e71d-0f67-456a-954b-291ca66ee375 service nova] Creating event network-vif-unplugged:3d034010-bd19-48b6-be03-cf18de52fc64 for instance 56c19929-6499-43ec-8b35-9edef57a737d on user Apr 21 15:42:28 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-ac7faa57-74f6-4909-8ecd-21241fb5ebfc req-d470e71d-0f67-456a-954b-291ca66ee375 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032024 Apr 21 15:42:28 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 123/371] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:42:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:42:30 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-e024854e-c707-434b-a50e-725b720da3f2 req-6c30a735-7f02-491e-87cb-f763d1ffb5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c19929-6499-43ec-8b35-9edef57a737d", "name": "network-vif-plugged", "status": "completed", "tag": "3d034010-bd19-48b6-be03-cf18de52fc64"}, {"server_uuid": "56c19929-6499-43ec-8b35-9edef57a737d", "name": "network-vif-deleted", "tag": "3d034010-bd19-48b6-be03-cf18de52fc64"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:42:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e024854e-c707-434b-a50e-725b720da3f2 req-6c30a735-7f02-491e-87cb-f763d1ffb5af service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e024854e-c707-434b-a50e-725b720da3f2 req-6c30a735-7f02-491e-87cb-f763d1ffb5af service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-e024854e-c707-434b-a50e-725b720da3f2 req-6c30a735-7f02-491e-87cb-f763d1ffb5af service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:30 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-e024854e-c707-434b-a50e-725b720da3f2 req-6c30a735-7f02-491e-87cb-f763d1ffb5af service nova] Creating event network-vif-plugged:3d034010-bd19-48b6-be03-cf18de52fc64 for instance 56c19929-6499-43ec-8b35-9edef57a737d on user Apr 21 15:42:30 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-e024854e-c707-434b-a50e-725b720da3f2 req-6c30a735-7f02-491e-87cb-f763d1ffb5af service nova] Creating event network-vif-deleted:3d034010-bd19-48b6-be03-cf18de52fc64 for instance 56c19929-6499-43ec-8b35-9edef57a737d on user Apr 21 15:42:30 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-e024854e-c707-434b-a50e-725b720da3f2 req-6c30a735-7f02-491e-87cb-f763d1ffb5af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028393 Apr 21 15:42:30 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 123/372] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:42:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:42:40 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-6e3eb076-f3b0-4505-8ce1-331541bfe8c0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:42:40 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-6e3eb076-f3b0-4505-8ce1-331541bfe8c0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 6aee29af-024c-4e5c-a893-87af63214df3] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:42:40 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=4 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:40 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=8 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:42:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-6e3eb076-f3b0-4505-8ce1-331541bfe8c0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-6e3eb076-f3b0-4505-8ce1-331541bfe8c0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-6e3eb076-f3b0-4505-8ce1-331541bfe8c0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-6e3eb076-f3b0-4505-8ce1-331541bfe8c0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:42:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-6e3eb076-f3b0-4505-8ce1-331541bfe8c0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:42:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-6e3eb076-f3b0-4505-8ce1-331541bfe8c0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:42:40 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-6e3eb076-f3b0-4505-8ce1-331541bfe8c0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecd98fdee134e4c82e721ee37b67553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72ad1c36d144329b11fa1284f3bfd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:42:40 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-6e3eb076-f3b0-4505-8ce1-331541bfe8c0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3" status: 200 len: 1536 microversion: 2.1 time: 0.230162 Apr 21 15:42:40 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 127/373] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:42:40 2023] GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3 => generated 1536 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:43:02 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:02 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=6 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:02 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-b4aebadc-92e4-417e-b64c-35911a0573af tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:02 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-b4aebadc-92e4-417e-b64c-35911a0573af tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] [instance: 5e6e1f23-e822-4a09-81f3-7e20ba206859] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:02 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-b4aebadc-92e4-417e-b64c-35911a0573af tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:02 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-b4aebadc-92e4-417e-b64c-35911a0573af tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:02 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-b4aebadc-92e4-417e-b64c-35911a0573af tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:02 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-b4aebadc-92e4-417e-b64c-35911a0573af tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:02 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-b4aebadc-92e4-417e-b64c-35911a0573af tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:02 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-b4aebadc-92e4-417e-b64c-35911a0573af tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:02 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-b4aebadc-92e4-417e-b64c-35911a0573af tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] HTTP exception thrown: Instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 could not be found. Apr 21 15:43:02 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-b4aebadc-92e4-417e-b64c-35911a0573af tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Request method failure captured: Apr 21 15:43:02 user devstack@n-api.service[61512]: request: GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 HTTP/1.1 Apr 21 15:43:02 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:43:02 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:43:02 user devstack@n-api.service[61512]: Connection: close Apr 21 15:43:02 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:43:02 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:43:02 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:43:02 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:43:02 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQqy9aMLWu7pYNnesliqHG9waLOEMET3NKaflhQNT5Nnc8bY5yHp9aF4SzYfCHbGuT-PBiebpKT3e6wz82nMy4aPy9MKgJeCGjENcpIj2pVoTw9P2dga1LrNK6LKQ5Ojtc5dhUA4zliBVR7Yuka3PmMhEGS5s4AWZSR8zVNgHLNyCCuM Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Project-Id: 646a4c1a69b34d6d99324c082d74efcb Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Project-Name: tempest-ServerActionsTestJSON-2143541682 Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/646a4c1a69b34d6d99324c082d74efcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/646a4c1a69b34d6d99324c082d74efcb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/646a4c1a69b34d6d99324c082d74efcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Tenant: tempest-ServerActionsTestJSON-2143541682 Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Tenant-Id: 646a4c1a69b34d6d99324c082d74efcb Apr 21 15:43:02 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-ServerActionsTestJSON-2143541682 Apr 21 15:43:02 user devstack@n-api.service[61512]: X-User: tempest-ServerActionsTestJSON-2143541682-project-member Apr 21 15:43:02 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:43:02 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:43:02 user devstack@n-api.service[61512]: X-User-Id: a0bf3ef5fa614461b212054b7b9cd479 Apr 21 15:43:02 user devstack@n-api.service[61512]: X-User-Name: tempest-ServerActionsTestJSON-2143541682-project-member Apr 21 15:43:02 user devstack@n-api.service[61512]: method: > Apr 21 15:43:02 user devstack@n-api.service[61512]: exception: Instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 could not be found. Apr 21 15:43:02 user devstack@n-api.service[61512]: action_args: {'id': '5e6e1f23-e822-4a09-81f3-7e20ba206859'} Apr 21 15:43:02 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 could not be found. Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 could not be found. Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 could not be found. Apr 21 15:43:02 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:02 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-b4aebadc-92e4-417e-b64c-35911a0573af tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Returning 404 to user: Instance 5e6e1f23-e822-4a09-81f3-7e20ba206859 could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:43:02 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-b4aebadc-92e4-417e-b64c-35911a0573af tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859" status: 404 len: 111 microversion: 2.1 time: 0.042095 Apr 21 15:43:02 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 124/374] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:43:02 2023] GET /compute/v2.1/servers/5e6e1f23-e822-4a09-81f3-7e20ba206859 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:43:02 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:02 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:02 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b9ddbb59-b798-4766-b5d8-e0ed8d7e74b5 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] Calling method '.version_select at 0x7f0c146c43a0>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:02 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b9ddbb59-b798-4766-b5d8-e0ed8d7e74b5 tempest-ServerActionsTestJSON-2143541682 tempest-ServerActionsTestJSON-2143541682-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113745404" status: 202 len: 0 microversion: 2.1 time: 0.029606 Apr 21 15:43:02 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 124/375] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 15:43:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113745404 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:43:06 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-ab3fcaec-c12d-4999-a1a0-8b3002d72fb5 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:06 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-ab3fcaec-c12d-4999-a1a0-8b3002d72fb5 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] [instance: 04dc176a-5a30-4595-b8a5-9e325cf274de] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:06 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:06 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:06 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ab3fcaec-c12d-4999-a1a0-8b3002d72fb5 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:06 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ab3fcaec-c12d-4999-a1a0-8b3002d72fb5 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:06 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ab3fcaec-c12d-4999-a1a0-8b3002d72fb5 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:06 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ab3fcaec-c12d-4999-a1a0-8b3002d72fb5 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:06 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ab3fcaec-c12d-4999-a1a0-8b3002d72fb5 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:06 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-ab3fcaec-c12d-4999-a1a0-8b3002d72fb5 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:07 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-ab3fcaec-c12d-4999-a1a0-8b3002d72fb5 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6447895405c454c9c881ae0a5cf9f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6dd680ccc7482cb9f545511a721bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:43:07 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-ab3fcaec-c12d-4999-a1a0-8b3002d72fb5 tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de" status: 200 len: 1570 microversion: 2.1 time: 0.239903 Apr 21 15:43:07 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 128/376] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:43:06 2023] GET /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de => generated 1570 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:43:08 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-6d69ceac-70ca-4cb4-aa37-81361ccbe22b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:08 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-6d69ceac-70ca-4cb4-aa37-81361ccbe22b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] [instance: 04dc176a-5a30-4595-b8a5-9e325cf274de] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:08 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6d69ceac-70ca-4cb4-aa37-81361ccbe22b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:08 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6d69ceac-70ca-4cb4-aa37-81361ccbe22b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:08 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6d69ceac-70ca-4cb4-aa37-81361ccbe22b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:08 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6d69ceac-70ca-4cb4-aa37-81361ccbe22b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:08 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6d69ceac-70ca-4cb4-aa37-81361ccbe22b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:08 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6d69ceac-70ca-4cb4-aa37-81361ccbe22b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:08 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-6d69ceac-70ca-4cb4-aa37-81361ccbe22b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] [instance: 04dc176a-5a30-4595-b8a5-9e325cf274de] Going to try to terminate instance {{(pid=61512) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:43:08 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-6d69ceac-70ca-4cb4-aa37-81361ccbe22b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de" status: 204 len: 0 microversion: 2.1 time: 0.115117 Apr 21 15:43:08 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 125/377] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:43:08 2023] DELETE /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:43:08 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-fcbbb118-9f5d-4368-b084-6353400799eb tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:08 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-fcbbb118-9f5d-4368-b084-6353400799eb tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] [instance: 04dc176a-5a30-4595-b8a5-9e325cf274de] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-fcbbb118-9f5d-4368-b084-6353400799eb tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-fcbbb118-9f5d-4368-b084-6353400799eb tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-fcbbb118-9f5d-4368-b084-6353400799eb tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-fcbbb118-9f5d-4368-b084-6353400799eb tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-fcbbb118-9f5d-4368-b084-6353400799eb tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:08 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-fcbbb118-9f5d-4368-b084-6353400799eb tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:08 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-fcbbb118-9f5d-4368-b084-6353400799eb tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6447895405c454c9c881ae0a5cf9f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6dd680ccc7482cb9f545511a721bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:43:08 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-fcbbb118-9f5d-4368-b084-6353400799eb tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de" status: 200 len: 1576 microversion: 2.1 time: 0.266160 Apr 21 15:43:08 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 125/378] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:43:08 2023] GET /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de => generated 1576 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:43:09 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-723eceec-ddf8-4eb0-b48a-a838791a35d8 req-dc743c44-bcee-4a9a-87d6-10090764470c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04dc176a-5a30-4595-b8a5-9e325cf274de", "name": "network-vif-unplugged", "status": "completed", "tag": "b03b4bcd-0685-4629-b461-a56ccc0e3af5"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:43:09 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-723eceec-ddf8-4eb0-b48a-a838791a35d8 req-dc743c44-bcee-4a9a-87d6-10090764470c service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:09 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-723eceec-ddf8-4eb0-b48a-a838791a35d8 req-dc743c44-bcee-4a9a-87d6-10090764470c service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:09 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-723eceec-ddf8-4eb0-b48a-a838791a35d8 req-dc743c44-bcee-4a9a-87d6-10090764470c service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:09 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-723eceec-ddf8-4eb0-b48a-a838791a35d8 req-dc743c44-bcee-4a9a-87d6-10090764470c service nova] Creating event network-vif-unplugged:b03b4bcd-0685-4629-b461-a56ccc0e3af5 for instance 04dc176a-5a30-4595-b8a5-9e325cf274de on user Apr 21 15:43:09 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-723eceec-ddf8-4eb0-b48a-a838791a35d8 req-dc743c44-bcee-4a9a-87d6-10090764470c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.184005 Apr 21 15:43:09 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 129/379] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:43:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:09 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-d25640fc-4e4a-432e-8a2f-0d0cf40b46ef req-b508f140-4117-40a7-81e3-3d8e6062ec47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04dc176a-5a30-4595-b8a5-9e325cf274de", "name": "network-vif-deleted", "tag": "b03b4bcd-0685-4629-b461-a56ccc0e3af5"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:43:09 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-d25640fc-4e4a-432e-8a2f-0d0cf40b46ef req-b508f140-4117-40a7-81e3-3d8e6062ec47 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:09 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-d25640fc-4e4a-432e-8a2f-0d0cf40b46ef req-b508f140-4117-40a7-81e3-3d8e6062ec47 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:09 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-d25640fc-4e4a-432e-8a2f-0d0cf40b46ef req-b508f140-4117-40a7-81e3-3d8e6062ec47 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:09 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-d25640fc-4e4a-432e-8a2f-0d0cf40b46ef req-b508f140-4117-40a7-81e3-3d8e6062ec47 service nova] Creating event network-vif-deleted:b03b4bcd-0685-4629-b461-a56ccc0e3af5 for instance 04dc176a-5a30-4595-b8a5-9e325cf274de on user Apr 21 15:43:09 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-d25640fc-4e4a-432e-8a2f-0d0cf40b46ef req-b508f140-4117-40a7-81e3-3d8e6062ec47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167465 Apr 21 15:43:09 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 126/380] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:43:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:11 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-33d34a7a-0405-48f9-871e-3a27189231db req-c04e59ec-bf83-4a19-8cdc-558da8701416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04dc176a-5a30-4595-b8a5-9e325cf274de", "name": "network-vif-plugged", "status": "completed", "tag": "b03b4bcd-0685-4629-b461-a56ccc0e3af5"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:43:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-33d34a7a-0405-48f9-871e-3a27189231db req-c04e59ec-bf83-4a19-8cdc-558da8701416 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-33d34a7a-0405-48f9-871e-3a27189231db req-c04e59ec-bf83-4a19-8cdc-558da8701416 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:11 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-33d34a7a-0405-48f9-871e-3a27189231db req-c04e59ec-bf83-4a19-8cdc-558da8701416 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:11 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-33d34a7a-0405-48f9-871e-3a27189231db req-c04e59ec-bf83-4a19-8cdc-558da8701416 service nova] Creating event network-vif-plugged:b03b4bcd-0685-4629-b461-a56ccc0e3af5 for instance 04dc176a-5a30-4595-b8a5-9e325cf274de on user Apr 21 15:43:11 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-33d34a7a-0405-48f9-871e-3a27189231db req-c04e59ec-bf83-4a19-8cdc-558da8701416 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033535 Apr 21 15:43:11 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 126/381] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:43:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:18 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-2219d58b-3ada-4c8e-a808-fa48a21e9b07 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:18 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-2219d58b-3ada-4c8e-a808-fa48a21e9b07 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: 56c19929-6499-43ec-8b35-9edef57a737d] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:18 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2219d58b-3ada-4c8e-a808-fa48a21e9b07 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:18 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2219d58b-3ada-4c8e-a808-fa48a21e9b07 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:18 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2219d58b-3ada-4c8e-a808-fa48a21e9b07 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:18 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2219d58b-3ada-4c8e-a808-fa48a21e9b07 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:18 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2219d58b-3ada-4c8e-a808-fa48a21e9b07 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:18 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2219d58b-3ada-4c8e-a808-fa48a21e9b07 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:18 user devstack@n-api.service[61511]: INFO nova.api.openstack.wsgi [None req-2219d58b-3ada-4c8e-a808-fa48a21e9b07 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] HTTP exception thrown: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:18 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-2219d58b-3ada-4c8e-a808-fa48a21e9b07 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Request method failure captured: Apr 21 15:43:18 user devstack@n-api.service[61511]: request: GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d HTTP/1.1 Apr 21 15:43:18 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:43:18 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:43:18 user devstack@n-api.service[61511]: Connection: close Apr 21 15:43:18 user devstack@n-api.service[61511]: Content-Length: 0 Apr 21 15:43:18 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:43:18 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:43:18 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:43:18 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQq3JAESS7QUZD1OUQnhIujfajBBNFVw4BkZwiZw57LzHKyBT2jdwDYCw1408_ZxQVkKzCG-ZS8FdddWTPHPCHQtdB37S4kpczvcqrE-fiL3opTSadMGdTAZoX3Rv69BXZ_fwhgDQRl05NDCCSSsEJ1HDJ6FfK50ARgPt8TTY2UYwVsA Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Project-Id: 5fd0ca20473c4272858416eec21729af Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fd0ca20473c4272858416eec21729af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fd0ca20473c4272858416eec21729af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5fd0ca20473c4272858416eec21729af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Tenant-Id: 5fd0ca20473c4272858416eec21729af Apr 21 15:43:18 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:18 user devstack@n-api.service[61511]: X-User: tempest-AttachVolumeShelveTestJSON-1258148986-project-member Apr 21 15:43:18 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:43:18 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:43:18 user devstack@n-api.service[61511]: X-User-Id: 01e796b65ab8485ca455f943b3ec2808 Apr 21 15:43:18 user devstack@n-api.service[61511]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1258148986-project-member Apr 21 15:43:18 user devstack@n-api.service[61511]: method: > Apr 21 15:43:18 user devstack@n-api.service[61511]: exception: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:18 user devstack@n-api.service[61511]: action_args: {'id': '56c19929-6499-43ec-8b35-9edef57a737d'} Apr 21 15:43:18 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:18 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:18 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-2219d58b-3ada-4c8e-a808-fa48a21e9b07 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Returning 404 to user: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:43:18 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-2219d58b-3ada-4c8e-a808-fa48a21e9b07 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d" status: 404 len: 111 microversion: 2.20 time: 0.196080 Apr 21 15:43:18 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 130/382] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:43:18 2023] GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 15:43:18 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-4332b9de-6aa6-4182-8b2b-8474afb20430 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '.version_select at 0x7f0c14652ef0>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:18 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-4332b9de-6aa6-4182-8b2b-8474afb20430 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064319406" status: 204 len: 0 microversion: 2.20 time: 0.030605 Apr 21 15:43:18 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 127/383] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 21 15:43:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2064319406 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c33d091d-1ecb-47ad-ad22-f4938ed60dbf tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-c33d091d-1ecb-47ad-ad22-f4938ed60dbf tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: 56c19929-6499-43ec-8b35-9edef57a737d] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c33d091d-1ecb-47ad-ad22-f4938ed60dbf tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c33d091d-1ecb-47ad-ad22-f4938ed60dbf tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c33d091d-1ecb-47ad-ad22-f4938ed60dbf tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c33d091d-1ecb-47ad-ad22-f4938ed60dbf tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c33d091d-1ecb-47ad-ad22-f4938ed60dbf tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-c33d091d-1ecb-47ad-ad22-f4938ed60dbf tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:19 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-c33d091d-1ecb-47ad-ad22-f4938ed60dbf tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] HTTP exception thrown: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c33d091d-1ecb-47ad-ad22-f4938ed60dbf tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Request method failure captured: Apr 21 15:43:19 user devstack@n-api.service[61510]: request: DELETE /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d HTTP/1.1 Apr 21 15:43:19 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:43:19 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:43:19 user devstack@n-api.service[61510]: Connection: close Apr 21 15:43:19 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:43:19 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:43:19 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:43:19 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:43:19 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQq3JAESS7QUZD1OUQnhIujfajBBNFVw4BkZwiZw57LzHKyBT2jdwDYCw1408_ZxQVkKzCG-ZS8FdddWTPHPCHQtdB37S4kpczvcqrE-fiL3opTSadMGdTAZoX3Rv69BXZ_fwhgDQRl05NDCCSSsEJ1HDJ6FfK50ARgPt8TTY2UYwVsA Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Project-Id: 5fd0ca20473c4272858416eec21729af Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fd0ca20473c4272858416eec21729af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fd0ca20473c4272858416eec21729af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5fd0ca20473c4272858416eec21729af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Tenant-Id: 5fd0ca20473c4272858416eec21729af Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:19 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeShelveTestJSON-1258148986-project-member Apr 21 15:43:19 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:43:19 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:43:19 user devstack@n-api.service[61510]: X-User-Id: 01e796b65ab8485ca455f943b3ec2808 Apr 21 15:43:19 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1258148986-project-member Apr 21 15:43:19 user devstack@n-api.service[61510]: method: > Apr 21 15:43:19 user devstack@n-api.service[61510]: exception: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:19 user devstack@n-api.service[61510]: action_args: {'id': '56c19929-6499-43ec-8b35-9edef57a737d'} Apr 21 15:43:19 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-c33d091d-1ecb-47ad-ad22-f4938ed60dbf tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Returning 404 to user: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:43:19 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-c33d091d-1ecb-47ad-ad22-f4938ed60dbf tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d" status: 404 len: 111 microversion: 2.20 time: 0.030126 Apr 21 15:43:19 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 127/384] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 15:43:19 2023] DELETE /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 21 15:43:19 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-8e86b932-5e71-47a3-9a1b-f20e7b9647ad tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:19 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-8e86b932-5e71-47a3-9a1b-f20e7b9647ad tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: 56c19929-6499-43ec-8b35-9edef57a737d] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:19 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-8e86b932-5e71-47a3-9a1b-f20e7b9647ad tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:19 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-8e86b932-5e71-47a3-9a1b-f20e7b9647ad tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:19 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-8e86b932-5e71-47a3-9a1b-f20e7b9647ad tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:19 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-8e86b932-5e71-47a3-9a1b-f20e7b9647ad tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:19 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-8e86b932-5e71-47a3-9a1b-f20e7b9647ad tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:19 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-8e86b932-5e71-47a3-9a1b-f20e7b9647ad tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:19 user devstack@n-api.service[61511]: INFO nova.api.openstack.wsgi [None req-8e86b932-5e71-47a3-9a1b-f20e7b9647ad tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] HTTP exception thrown: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:19 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-8e86b932-5e71-47a3-9a1b-f20e7b9647ad tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Request method failure captured: Apr 21 15:43:19 user devstack@n-api.service[61511]: request: GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d HTTP/1.1 Apr 21 15:43:19 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:43:19 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:43:19 user devstack@n-api.service[61511]: Connection: close Apr 21 15:43:19 user devstack@n-api.service[61511]: Content-Length: 0 Apr 21 15:43:19 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:43:19 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:43:19 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:43:19 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQq3JAESS7QUZD1OUQnhIujfajBBNFVw4BkZwiZw57LzHKyBT2jdwDYCw1408_ZxQVkKzCG-ZS8FdddWTPHPCHQtdB37S4kpczvcqrE-fiL3opTSadMGdTAZoX3Rv69BXZ_fwhgDQRl05NDCCSSsEJ1HDJ6FfK50ARgPt8TTY2UYwVsA Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Project-Id: 5fd0ca20473c4272858416eec21729af Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fd0ca20473c4272858416eec21729af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fd0ca20473c4272858416eec21729af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5fd0ca20473c4272858416eec21729af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Tenant-Id: 5fd0ca20473c4272858416eec21729af Apr 21 15:43:19 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:19 user devstack@n-api.service[61511]: X-User: tempest-AttachVolumeShelveTestJSON-1258148986-project-member Apr 21 15:43:19 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:43:19 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:43:19 user devstack@n-api.service[61511]: X-User-Id: 01e796b65ab8485ca455f943b3ec2808 Apr 21 15:43:19 user devstack@n-api.service[61511]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1258148986-project-member Apr 21 15:43:19 user devstack@n-api.service[61511]: method: > Apr 21 15:43:19 user devstack@n-api.service[61511]: exception: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:19 user devstack@n-api.service[61511]: action_args: {'id': '56c19929-6499-43ec-8b35-9edef57a737d'} Apr 21 15:43:19 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. Apr 21 15:43:19 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-8e86b932-5e71-47a3-9a1b-f20e7b9647ad tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Returning 404 to user: Instance 56c19929-6499-43ec-8b35-9edef57a737d could not be found. {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:43:19 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-8e86b932-5e71-47a3-9a1b-f20e7b9647ad tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d" status: 404 len: 111 microversion: 2.20 time: 0.032053 Apr 21 15:43:19 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 131/385] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:43:19 2023] GET /compute/v2.1/servers/56c19929-6499-43ec-8b35-9edef57a737d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 15:43:19 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-8601b79a-0f8d-4a60-a770-729077e20432 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:19 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-8601b79a-0f8d-4a60-a770-729077e20432 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: db6cadfe-b33c-4e4b-867a-dce34e0b4958] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:19 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-8601b79a-0f8d-4a60-a770-729077e20432 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:19 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-8601b79a-0f8d-4a60-a770-729077e20432 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:19 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-8601b79a-0f8d-4a60-a770-729077e20432 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:19 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-8601b79a-0f8d-4a60-a770-729077e20432 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:19 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-8601b79a-0f8d-4a60-a770-729077e20432 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:19 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-8601b79a-0f8d-4a60-a770-729077e20432 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:19 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-8601b79a-0f8d-4a60-a770-729077e20432 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] HTTP exception thrown: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:43:19 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-8601b79a-0f8d-4a60-a770-729077e20432 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Request method failure captured: Apr 21 15:43:19 user devstack@n-api.service[61512]: request: DELETE /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958 HTTP/1.1 Apr 21 15:43:19 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:43:19 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:43:19 user devstack@n-api.service[61512]: Connection: close Apr 21 15:43:19 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:43:19 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:43:19 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:43:19 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:43:19 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQq3JAESS7QUZD1OUQnhIujfajBBNFVw4BkZwiZw57LzHKyBT2jdwDYCw1408_ZxQVkKzCG-ZS8FdddWTPHPCHQtdB37S4kpczvcqrE-fiL3opTSadMGdTAZoX3Rv69BXZ_fwhgDQRl05NDCCSSsEJ1HDJ6FfK50ARgPt8TTY2UYwVsA Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Project-Id: 5fd0ca20473c4272858416eec21729af Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fd0ca20473c4272858416eec21729af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fd0ca20473c4272858416eec21729af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5fd0ca20473c4272858416eec21729af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Tenant-Id: 5fd0ca20473c4272858416eec21729af Apr 21 15:43:19 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:19 user devstack@n-api.service[61512]: X-User: tempest-AttachVolumeShelveTestJSON-1258148986-project-member Apr 21 15:43:19 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:43:19 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:43:19 user devstack@n-api.service[61512]: X-User-Id: 01e796b65ab8485ca455f943b3ec2808 Apr 21 15:43:19 user devstack@n-api.service[61512]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1258148986-project-member Apr 21 15:43:19 user devstack@n-api.service[61512]: method: > Apr 21 15:43:19 user devstack@n-api.service[61512]: exception: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:43:19 user devstack@n-api.service[61512]: action_args: {'id': 'db6cadfe-b33c-4e4b-867a-dce34e0b4958'} Apr 21 15:43:19 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:43:19 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-8601b79a-0f8d-4a60-a770-729077e20432 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Returning 404 to user: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:43:19 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-8601b79a-0f8d-4a60-a770-729077e20432 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958" status: 404 len: 111 microversion: 2.20 time: 0.031913 Apr 21 15:43:19 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 128/386] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 21 15:43:19 2023] DELETE /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-77d97e1b-b64f-4a66-bc57-6ad2f8cacbe2 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-77d97e1b-b64f-4a66-bc57-6ad2f8cacbe2 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] [instance: db6cadfe-b33c-4e4b-867a-dce34e0b4958] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-77d97e1b-b64f-4a66-bc57-6ad2f8cacbe2 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-77d97e1b-b64f-4a66-bc57-6ad2f8cacbe2 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-77d97e1b-b64f-4a66-bc57-6ad2f8cacbe2 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-77d97e1b-b64f-4a66-bc57-6ad2f8cacbe2 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-77d97e1b-b64f-4a66-bc57-6ad2f8cacbe2 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-77d97e1b-b64f-4a66-bc57-6ad2f8cacbe2 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:19 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-77d97e1b-b64f-4a66-bc57-6ad2f8cacbe2 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] HTTP exception thrown: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-77d97e1b-b64f-4a66-bc57-6ad2f8cacbe2 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Request method failure captured: Apr 21 15:43:19 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958 HTTP/1.1 Apr 21 15:43:19 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:43:19 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:43:19 user devstack@n-api.service[61510]: Connection: close Apr 21 15:43:19 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:43:19 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:43:19 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:43:19 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:43:19 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQq3JAESS7QUZD1OUQnhIujfajBBNFVw4BkZwiZw57LzHKyBT2jdwDYCw1408_ZxQVkKzCG-ZS8FdddWTPHPCHQtdB37S4kpczvcqrE-fiL3opTSadMGdTAZoX3Rv69BXZ_fwhgDQRl05NDCCSSsEJ1HDJ6FfK50ARgPt8TTY2UYwVsA Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Openstack-Nova-Api-Version: 2.20 Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Project-Id: 5fd0ca20473c4272858416eec21729af Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fd0ca20473c4272858416eec21729af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5fd0ca20473c4272858416eec21729af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5fd0ca20473c4272858416eec21729af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Tenant-Id: 5fd0ca20473c4272858416eec21729af Apr 21 15:43:19 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1258148986 Apr 21 15:43:19 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeShelveTestJSON-1258148986-project-member Apr 21 15:43:19 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:43:19 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:43:19 user devstack@n-api.service[61510]: X-User-Id: 01e796b65ab8485ca455f943b3ec2808 Apr 21 15:43:19 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1258148986-project-member Apr 21 15:43:19 user devstack@n-api.service[61510]: method: > Apr 21 15:43:19 user devstack@n-api.service[61510]: exception: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:43:19 user devstack@n-api.service[61510]: action_args: {'id': 'db6cadfe-b33c-4e4b-867a-dce34e0b4958'} Apr 21 15:43:19 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. Apr 21 15:43:19 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:43:19 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-77d97e1b-b64f-4a66-bc57-6ad2f8cacbe2 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] Returning 404 to user: Instance db6cadfe-b33c-4e4b-867a-dce34e0b4958 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:43:19 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-77d97e1b-b64f-4a66-bc57-6ad2f8cacbe2 tempest-AttachVolumeShelveTestJSON-1258148986 tempest-AttachVolumeShelveTestJSON-1258148986-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958" status: 404 len: 111 microversion: 2.20 time: 0.027214 Apr 21 15:43:19 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 128/387] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 21 15:43:19 2023] GET /compute/v2.1/servers/db6cadfe-b33c-4e4b-867a-dce34e0b4958 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 21 15:43:23 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-e5e0bff3-452a-45d1-aec2-3e0be96601f2 tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] Action: 'create', calling method: .version_select at 0x7f0c145360e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1078361489", "metadata": {"Type": "work"}}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:43:24 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-e5e0bff3-452a-45d1-aec2-3e0be96601f2 tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.530911 Apr 21 15:43:24 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 132/388] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 21 15:43:23 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 533 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 21 15:43:24 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-780c4f55-6f04-4123-a017-d48b4bb48d50 tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] Calling method '.version_select at 0x7f0c14651f30>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:24 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-780c4f55-6f04-4123-a017-d48b4bb48d50 tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3" status: 200 len: 350 microversion: 2.1 time: 0.254329 Apr 21 15:43:24 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 129/389] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 15:43:24 2023] GET /compute/v2.1/os-volumes/c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3 => generated 350 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:25 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-e6d8791d-b0b3-4ec9-b961-fcb6e007e511 tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] Calling method '.version_select at 0x7f0c146c4160>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-e6d8791d-b0b3-4ec9-b961-fcb6e007e511 tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3" status: 200 len: 350 microversion: 2.1 time: 0.049881 Apr 21 15:43:25 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 129/390] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 15:43:25 2023] GET /compute/v2.1/os-volumes/c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:25 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-99d0cd84-6ae3-4c80-8085-4bc923d11881 tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] Calling method '.version_select at 0x7f0c1456eb90>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:25 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-99d0cd84-6ae3-4c80-8085-4bc923d11881 tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3" status: 202 len: 0 microversion: 2.1 time: 0.172040 Apr 21 15:43:25 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 133/391] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 15:43:25 2023] DELETE /compute/v2.1/os-volumes/c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:43:25 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-81e1648f-c0a6-42dc-bcd2-5317d7b6dbab tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] Calling method '.version_select at 0x7f0c146b6830>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:25 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-81e1648f-c0a6-42dc-bcd2-5317d7b6dbab tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] HTTP exception thrown: Volume c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3 could not be found. Apr 21 15:43:25 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-81e1648f-c0a6-42dc-bcd2-5317d7b6dbab tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] Request method failure captured: Apr 21 15:43:25 user devstack@n-api.service[61512]: request: GET /compute/v2.1/os-volumes/c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3 HTTP/1.1 Apr 21 15:43:25 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:43:25 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:43:25 user devstack@n-api.service[61512]: Connection: close Apr 21 15:43:25 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:43:25 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:43:25 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:43:25 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:43:25 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQq8bWQbI_2f8zMlCRK-yT54U2latnKfq7JEuLj2mJuuKYn2dlA4uexWHwVdo_xm_hNOiGcBfLR5VFr7c38QwtWaO8i3-lbRNpnjFCyXznKwtv0KPnQSw9iIG6n4wUqLIivWLM8Niu9Js99Doj1BhhHXvypVbhNfEFrGBTSrp-cgQ1xE Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Project-Id: 598bef8e2853448c80a8db96a5a3b3b5 Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Project-Name: tempest-VolumesGetTestJSON-1042160744 Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/598bef8e2853448c80a8db96a5a3b3b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/598bef8e2853448c80a8db96a5a3b3b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/598bef8e2853448c80a8db96a5a3b3b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Tenant: tempest-VolumesGetTestJSON-1042160744 Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Tenant-Id: 598bef8e2853448c80a8db96a5a3b3b5 Apr 21 15:43:25 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-VolumesGetTestJSON-1042160744 Apr 21 15:43:25 user devstack@n-api.service[61512]: X-User: tempest-VolumesGetTestJSON-1042160744-project-member Apr 21 15:43:25 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:43:25 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:43:25 user devstack@n-api.service[61512]: X-User-Id: 23691d0d08a94f19904424986ed23423 Apr 21 15:43:25 user devstack@n-api.service[61512]: X-User-Name: tempest-VolumesGetTestJSON-1042160744-project-member Apr 21 15:43:25 user devstack@n-api.service[61512]: method: Apr 21 15:43:25 user devstack@n-api.service[61512]: exception: Volume c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3 could not be found. Apr 21 15:43:25 user devstack@n-api.service[61512]: action_args: {'id': 'c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3'} Apr 21 15:43:25 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3 could not be found. (HTTP 404) (Request-ID: req-b0a06390-7568-40b5-b820-8ee3a192e370) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3 could not be found. Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3 could not be found. Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3 could not be found. Apr 21 15:43:25 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:43:25 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-81e1648f-c0a6-42dc-bcd2-5317d7b6dbab tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] Returning 404 to user: Volume c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3 could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:43:25 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-81e1648f-c0a6-42dc-bcd2-5317d7b6dbab tempest-VolumesGetTestJSON-1042160744 tempest-VolumesGetTestJSON-1042160744-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3" status: 404 len: 109 microversion: 2.1 time: 0.034390 Apr 21 15:43:25 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 130/392] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 21 15:43:25 2023] GET /compute/v2.1/os-volumes/c18fc0fb-dcdf-411c-a1e6-bbe9b2f7f7e3 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:43:40 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:40 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=12 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:40 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-cb9c6a09-52ba-4839-9cd6-b2f21b06b5fc tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:40 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-cb9c6a09-52ba-4839-9cd6-b2f21b06b5fc tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 6aee29af-024c-4e5c-a893-87af63214df3] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-cb9c6a09-52ba-4839-9cd6-b2f21b06b5fc tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-cb9c6a09-52ba-4839-9cd6-b2f21b06b5fc tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-cb9c6a09-52ba-4839-9cd6-b2f21b06b5fc tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-cb9c6a09-52ba-4839-9cd6-b2f21b06b5fc tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-cb9c6a09-52ba-4839-9cd6-b2f21b06b5fc tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-cb9c6a09-52ba-4839-9cd6-b2f21b06b5fc tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:40 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-cb9c6a09-52ba-4839-9cd6-b2f21b06b5fc tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.212384 Apr 21 15:43:40 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 130/393] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 15:43:40 2023] GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3/os-interface => generated 283 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:42 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=8 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:42 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=12 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:42 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-51dca904-7607-4c10-bc74-75e7f80c6157 req-d6fbbc2f-6a68-4ac3-930c-043acb5f7981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aee29af-024c-4e5c-a893-87af63214df3", "tag": "8615b97c-5299-439d-a60d-9e831d0910f8"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:43:42 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-51dca904-7607-4c10-bc74-75e7f80c6157 req-d6fbbc2f-6a68-4ac3-930c-043acb5f7981 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:42 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-51dca904-7607-4c10-bc74-75e7f80c6157 req-d6fbbc2f-6a68-4ac3-930c-043acb5f7981 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:42 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-51dca904-7607-4c10-bc74-75e7f80c6157 req-d6fbbc2f-6a68-4ac3-930c-043acb5f7981 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:42 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-51dca904-7607-4c10-bc74-75e7f80c6157 req-d6fbbc2f-6a68-4ac3-930c-043acb5f7981 service nova] Creating event network-changed:8615b97c-5299-439d-a60d-9e831d0910f8 for instance 6aee29af-024c-4e5c-a893-87af63214df3 on user Apr 21 15:43:42 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-51dca904-7607-4c10-bc74-75e7f80c6157 req-d6fbbc2f-6a68-4ac3-930c-043acb5f7981 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045689 Apr 21 15:43:42 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 134/394] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:43:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:42 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:42 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:42 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-7153d1a7-44d9-48c6-a621-2e4ed1fb9414 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:42 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-7153d1a7-44d9-48c6-a621-2e4ed1fb9414 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 6aee29af-024c-4e5c-a893-87af63214df3] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-7153d1a7-44d9-48c6-a621-2e4ed1fb9414 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-7153d1a7-44d9-48c6-a621-2e4ed1fb9414 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-7153d1a7-44d9-48c6-a621-2e4ed1fb9414 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-7153d1a7-44d9-48c6-a621-2e4ed1fb9414 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-7153d1a7-44d9-48c6-a621-2e4ed1fb9414 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:42 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-7153d1a7-44d9-48c6-a621-2e4ed1fb9414 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:42 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-7153d1a7-44d9-48c6-a621-2e4ed1fb9414 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3/ips" status: 200 len: 105 microversion: 2.1 time: 0.050892 Apr 21 15:43:42 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 131/395] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 15:43:42 2023] GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3/ips => generated 105 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:44 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-9e3a5c84-d991-44fd-88a2-e719e06f371f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:44 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-9e3a5c84-d991-44fd-88a2-e719e06f371f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 6aee29af-024c-4e5c-a893-87af63214df3] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9e3a5c84-d991-44fd-88a2-e719e06f371f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9e3a5c84-d991-44fd-88a2-e719e06f371f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9e3a5c84-d991-44fd-88a2-e719e06f371f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9e3a5c84-d991-44fd-88a2-e719e06f371f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9e3a5c84-d991-44fd-88a2-e719e06f371f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:44 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9e3a5c84-d991-44fd-88a2-e719e06f371f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:44 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-9e3a5c84-d991-44fd-88a2-e719e06f371f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 6aee29af-024c-4e5c-a893-87af63214df3] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:43:44 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-9e3a5c84-d991-44fd-88a2-e719e06f371f tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3" status: 204 len: 0 microversion: 2.1 time: 0.108181 Apr 21 15:43:44 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 131/396] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:43:44 2023] DELETE /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:43:44 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-55fa78ba-02a8-439d-8835-3ae5b76c1c8b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:44 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-55fa78ba-02a8-439d-8835-3ae5b76c1c8b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 6aee29af-024c-4e5c-a893-87af63214df3] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:44 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-55fa78ba-02a8-439d-8835-3ae5b76c1c8b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:44 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-55fa78ba-02a8-439d-8835-3ae5b76c1c8b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:44 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-55fa78ba-02a8-439d-8835-3ae5b76c1c8b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:44 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-55fa78ba-02a8-439d-8835-3ae5b76c1c8b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:44 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-55fa78ba-02a8-439d-8835-3ae5b76c1c8b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:44 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-55fa78ba-02a8-439d-8835-3ae5b76c1c8b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:44 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-55fa78ba-02a8-439d-8835-3ae5b76c1c8b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecd98fdee134e4c82e721ee37b67553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72ad1c36d144329b11fa1284f3bfd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:43:44 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-55fa78ba-02a8-439d-8835-3ae5b76c1c8b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3" status: 200 len: 1661 microversion: 2.1 time: 0.242587 Apr 21 15:43:44 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 135/397] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:43:44 2023] GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3 => generated 1661 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:43:44 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-1f2d6cb8-d2c0-4898-9ec3-f5ea94dbc2b5 req-553da36e-9af0-4b35-ad94-57a99e1a09e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aee29af-024c-4e5c-a893-87af63214df3", "name": "network-vif-unplugged", "status": "completed", "tag": "8615b97c-5299-439d-a60d-9e831d0910f8"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:43:44 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-1f2d6cb8-d2c0-4898-9ec3-f5ea94dbc2b5 req-553da36e-9af0-4b35-ad94-57a99e1a09e4 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:44 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-1f2d6cb8-d2c0-4898-9ec3-f5ea94dbc2b5 req-553da36e-9af0-4b35-ad94-57a99e1a09e4 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:44 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-1f2d6cb8-d2c0-4898-9ec3-f5ea94dbc2b5 req-553da36e-9af0-4b35-ad94-57a99e1a09e4 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:44 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-1f2d6cb8-d2c0-4898-9ec3-f5ea94dbc2b5 req-553da36e-9af0-4b35-ad94-57a99e1a09e4 service nova] Creating event network-vif-unplugged:8615b97c-5299-439d-a60d-9e831d0910f8 for instance 6aee29af-024c-4e5c-a893-87af63214df3 on user Apr 21 15:43:44 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-1f2d6cb8-d2c0-4898-9ec3-f5ea94dbc2b5 req-553da36e-9af0-4b35-ad94-57a99e1a09e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031975 Apr 21 15:43:44 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 132/398] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:43:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:45 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-19d139fd-7cb9-498c-9429-fb7e9a245e7f tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Action: 'create', calling method: .version_select at 0x7f0c146c7be0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-204054769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZCNh8LF8GoDzBiOSDWas6E5IY6v8XYdYY+JQjjz/6SQ4jMLgY8HrJ5YRdS2NZdjXVdH/Z9qqyefjN03sT70QcAt6diEo8xWECpkObZEzv79QHKGdREsmOb/r1sQp+UkQ=="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:43:45 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-19d139fd-7cb9-498c-9429-fb7e9a245e7f tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Getting quotas for project 4f94bc14394246d6b1276f163d904fcb. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:43:45 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-19d139fd-7cb9-498c-9429-fb7e9a245e7f tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Getting quotas for user 87426e3ed6b24719a304a9fffd4521ae and project 4f94bc14394246d6b1276f163d904fcb. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:43:45 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-19d139fd-7cb9-498c-9429-fb7e9a245e7f tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047569 Apr 21 15:43:45 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 132/399] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:43:45 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:45 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1280564620", "imageRef": "1e332ff8-70f4-48c4-aaa8-e30aba7c117f", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-204054769", "networks": [{"uuid": "cda34f8a-2ac2-4191-921f-ce37a1ff0a64"}]}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:43:45 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] validate_networks() for [('cda34f8a-2ac2-4191-921f-ce37a1ff0a64', None, None, None, None, None)] {{(pid=61511) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Flavor limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Image limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Flavor pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Image pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Getting quotas for project 4f94bc14394246d6b1276f163d904fcb. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Getting quotas for user 87426e3ed6b24719a304a9fffd4521ae and project 4f94bc14394246d6b1276f163d904fcb. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Going to run 1 instances... {{(pid=61511) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:43:46 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: 395173ea-75ed-4ae7-9404-69c612b71ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1e332ff8-70f4-48c4-aaa8-e30aba7c117f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:43:46 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-3fedd080-e781-44d9-8c7d-6c8d5fecfc58 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.782593 Apr 21 15:43:46 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 136/400] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:43:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:43:46 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-3cd253a4-847b-4e02-8623-7e298efca73c tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:46 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-3cd253a4-847b-4e02-8623-7e298efca73c tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: 395173ea-75ed-4ae7-9404-69c612b71ffa] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:46 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-3cd253a4-847b-4e02-8623-7e298efca73c tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87426e3ed6b24719a304a9fffd4521ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f94bc14394246d6b1276f163d904fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:43:46 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-3cd253a4-847b-4e02-8623-7e298efca73c tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa" status: 200 len: 1252 microversion: 2.1 time: 0.078158 Apr 21 15:43:46 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 133/401] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:43:46 2023] GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa => generated 1252 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:43:46 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-d0abf1b4-b5da-484c-964b-09c7119ef84f req-b3b3b81b-f4fd-46dc-b230-2a5376dc0dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aee29af-024c-4e5c-a893-87af63214df3", "name": "network-vif-plugged", "status": "completed", "tag": "8615b97c-5299-439d-a60d-9e831d0910f8"}, {"server_uuid": "6aee29af-024c-4e5c-a893-87af63214df3", "name": "network-vif-deleted", "tag": "8615b97c-5299-439d-a60d-9e831d0910f8"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:43:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d0abf1b4-b5da-484c-964b-09c7119ef84f req-b3b3b81b-f4fd-46dc-b230-2a5376dc0dfb service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d0abf1b4-b5da-484c-964b-09c7119ef84f req-b3b3b81b-f4fd-46dc-b230-2a5376dc0dfb service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:46 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d0abf1b4-b5da-484c-964b-09c7119ef84f req-b3b3b81b-f4fd-46dc-b230-2a5376dc0dfb service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:46 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-d0abf1b4-b5da-484c-964b-09c7119ef84f req-b3b3b81b-f4fd-46dc-b230-2a5376dc0dfb service nova] Creating event network-vif-plugged:8615b97c-5299-439d-a60d-9e831d0910f8 for instance 6aee29af-024c-4e5c-a893-87af63214df3 on user Apr 21 15:43:46 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-d0abf1b4-b5da-484c-964b-09c7119ef84f req-b3b3b81b-f4fd-46dc-b230-2a5376dc0dfb service nova] Creating event network-vif-deleted:8615b97c-5299-439d-a60d-9e831d0910f8 for instance 6aee29af-024c-4e5c-a893-87af63214df3 on user Apr 21 15:43:46 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-d0abf1b4-b5da-484c-964b-09c7119ef84f req-b3b3b81b-f4fd-46dc-b230-2a5376dc0dfb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.027744 Apr 21 15:43:46 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 133/402] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:43:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:48 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-5c888b85-d33a-4af3-ba1e-c4d05b17ce61 req-661a3704-3e12-4ad3-aaf8-82474daaaa09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "395173ea-75ed-4ae7-9404-69c612b71ffa", "tag": "4d4c4504-7ec7-431f-9ff2-47ed79510c5a"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:43:48 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-5c888b85-d33a-4af3-ba1e-c4d05b17ce61 req-661a3704-3e12-4ad3-aaf8-82474daaaa09 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:48 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-5c888b85-d33a-4af3-ba1e-c4d05b17ce61 req-661a3704-3e12-4ad3-aaf8-82474daaaa09 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:48 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-5c888b85-d33a-4af3-ba1e-c4d05b17ce61 req-661a3704-3e12-4ad3-aaf8-82474daaaa09 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:48 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-5c888b85-d33a-4af3-ba1e-c4d05b17ce61 req-661a3704-3e12-4ad3-aaf8-82474daaaa09 service nova] Creating event network-changed:4d4c4504-7ec7-431f-9ff2-47ed79510c5a for instance 395173ea-75ed-4ae7-9404-69c612b71ffa on user Apr 21 15:43:48 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-5c888b85-d33a-4af3-ba1e-c4d05b17ce61 req-661a3704-3e12-4ad3-aaf8-82474daaaa09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036510 Apr 21 15:43:48 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 137/403] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:43:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:51 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-b7f73e1e-9928-4dcb-b9f6-95c053155149 req-bde8ad2a-9799-454f-802a-c85b20a56135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395173ea-75ed-4ae7-9404-69c612b71ffa", "name": "network-vif-plugged", "status": "completed", "tag": "4d4c4504-7ec7-431f-9ff2-47ed79510c5a"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:43:51 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-b7f73e1e-9928-4dcb-b9f6-95c053155149 req-bde8ad2a-9799-454f-802a-c85b20a56135 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:51 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-b7f73e1e-9928-4dcb-b9f6-95c053155149 req-bde8ad2a-9799-454f-802a-c85b20a56135 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:51 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-b7f73e1e-9928-4dcb-b9f6-95c053155149 req-bde8ad2a-9799-454f-802a-c85b20a56135 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:51 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-b7f73e1e-9928-4dcb-b9f6-95c053155149 req-bde8ad2a-9799-454f-802a-c85b20a56135 service nova] Creating event network-vif-plugged:4d4c4504-7ec7-431f-9ff2-47ed79510c5a for instance 395173ea-75ed-4ae7-9404-69c612b71ffa on user Apr 21 15:43:51 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-b7f73e1e-9928-4dcb-b9f6-95c053155149 req-bde8ad2a-9799-454f-802a-c85b20a56135 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050764 Apr 21 15:43:51 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 134/404] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:43:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:53 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-d26f6f86-7d23-4199-850d-a4c3f6688ce1 req-3450853b-1f5c-4afd-ad04-7c682ec669b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395173ea-75ed-4ae7-9404-69c612b71ffa", "name": "network-vif-plugged", "status": "completed", "tag": "4d4c4504-7ec7-431f-9ff2-47ed79510c5a"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:43:53 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d26f6f86-7d23-4199-850d-a4c3f6688ce1 req-3450853b-1f5c-4afd-ad04-7c682ec669b8 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:53 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d26f6f86-7d23-4199-850d-a4c3f6688ce1 req-3450853b-1f5c-4afd-ad04-7c682ec669b8 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:53 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-d26f6f86-7d23-4199-850d-a4c3f6688ce1 req-3450853b-1f5c-4afd-ad04-7c682ec669b8 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:53 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-d26f6f86-7d23-4199-850d-a4c3f6688ce1 req-3450853b-1f5c-4afd-ad04-7c682ec669b8 service nova] Creating event network-vif-plugged:4d4c4504-7ec7-431f-9ff2-47ed79510c5a for instance 395173ea-75ed-4ae7-9404-69c612b71ffa on user Apr 21 15:43:53 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-d26f6f86-7d23-4199-850d-a4c3f6688ce1 req-3450853b-1f5c-4afd-ad04-7c682ec669b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031555 Apr 21 15:43:53 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 134/405] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:43:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:43:58 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:58 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:58 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:58 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=12 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:58 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-34f2cb03-9830-4324-91c4-051b0caf740b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:58 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-34f2cb03-9830-4324-91c4-051b0caf740b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] [instance: 04dc176a-5a30-4595-b8a5-9e325cf274de] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:43:58 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-34f2cb03-9830-4324-91c4-051b0caf740b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:58 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-34f2cb03-9830-4324-91c4-051b0caf740b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:58 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-34f2cb03-9830-4324-91c4-051b0caf740b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:58 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-34f2cb03-9830-4324-91c4-051b0caf740b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:43:58 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-34f2cb03-9830-4324-91c4-051b0caf740b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:43:58 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-34f2cb03-9830-4324-91c4-051b0caf740b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:43:59 user devstack@n-api.service[61511]: INFO nova.api.openstack.wsgi [None req-34f2cb03-9830-4324-91c4-051b0caf740b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] HTTP exception thrown: Instance 04dc176a-5a30-4595-b8a5-9e325cf274de could not be found. Apr 21 15:43:59 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-34f2cb03-9830-4324-91c4-051b0caf740b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Request method failure captured: Apr 21 15:43:59 user devstack@n-api.service[61511]: request: GET /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de HTTP/1.1 Apr 21 15:43:59 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:43:59 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:43:59 user devstack@n-api.service[61511]: Connection: close Apr 21 15:43:59 user devstack@n-api.service[61511]: Content-Length: 0 Apr 21 15:43:59 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:43:59 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:43:59 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:43:59 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQq6UDAyGrT5ppn-b1Eu2m1JuoJs9OUSbSfPIy1Lk8R2g8UmbXHwQQLZMa3K3was-LaiM7m_iBU-6zs5cj5WXRVkN6r_a7IHXaRjPdMZmr1QqjSI87g2DW36oew3kkqWJ3nylLQf892BUbxpcCDK1ADNlaV9NBNAd7pDadS8cpztg8qk Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Project-Id: ef6dd680ccc7482cb9f545511a721bc5 Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1618473131 Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef6dd680ccc7482cb9f545511a721bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef6dd680ccc7482cb9f545511a721bc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ef6dd680ccc7482cb9f545511a721bc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Tenant: tempest-SnapshotDataIntegrityTests-1618473131 Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Tenant-Id: ef6dd680ccc7482cb9f545511a721bc5 Apr 21 15:43:59 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1618473131 Apr 21 15:43:59 user devstack@n-api.service[61511]: X-User: tempest-SnapshotDataIntegrityTests-1618473131-project-member Apr 21 15:43:59 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:43:59 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:43:59 user devstack@n-api.service[61511]: X-User-Id: c6447895405c454c9c881ae0a5cf9f5b Apr 21 15:43:59 user devstack@n-api.service[61511]: X-User-Name: tempest-SnapshotDataIntegrityTests-1618473131-project-member Apr 21 15:43:59 user devstack@n-api.service[61511]: method: > Apr 21 15:43:59 user devstack@n-api.service[61511]: exception: Instance 04dc176a-5a30-4595-b8a5-9e325cf274de could not be found. Apr 21 15:43:59 user devstack@n-api.service[61511]: action_args: {'id': '04dc176a-5a30-4595-b8a5-9e325cf274de'} Apr 21 15:43:59 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04dc176a-5a30-4595-b8a5-9e325cf274de could not be found. Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04dc176a-5a30-4595-b8a5-9e325cf274de could not be found. Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04dc176a-5a30-4595-b8a5-9e325cf274de could not be found. Apr 21 15:43:59 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:43:59 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-34f2cb03-9830-4324-91c4-051b0caf740b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Returning 404 to user: Instance 04dc176a-5a30-4595-b8a5-9e325cf274de could not be found. {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:43:59 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-34f2cb03-9830-4324-91c4-051b0caf740b tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de" status: 404 len: 111 microversion: 2.1 time: 0.040848 Apr 21 15:43:59 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 138/406] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:43:58 2023] GET /compute/v2.1/servers/04dc176a-5a30-4595-b8a5-9e325cf274de => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:43:59 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:43:59 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-fffc23cc-79da-4fed-acbb-290c76ae73ab tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] Calling method '.version_select at 0x7f0c146b7be0>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:43:59 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-fffc23cc-79da-4fed-acbb-290c76ae73ab tempest-SnapshotDataIntegrityTests-1618473131 tempest-SnapshotDataIntegrityTests-1618473131-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1139182494" status: 202 len: 0 microversion: 2.1 time: 0.027391 Apr 21 15:43:59 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 135/407] 10.0.0.210 () {62 vars in 1355 bytes} [Fri Apr 21 15:43:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1139182494 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-65ae3e89-b29f-4efc-805c-18268637e972 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-65ae3e89-b29f-4efc-805c-18268637e972 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 6aee29af-024c-4e5c-a893-87af63214df3] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-65ae3e89-b29f-4efc-805c-18268637e972 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-65ae3e89-b29f-4efc-805c-18268637e972 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-65ae3e89-b29f-4efc-805c-18268637e972 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-65ae3e89-b29f-4efc-805c-18268637e972 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-65ae3e89-b29f-4efc-805c-18268637e972 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-65ae3e89-b29f-4efc-805c-18268637e972 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:44:34 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-65ae3e89-b29f-4efc-805c-18268637e972 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] HTTP exception thrown: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-65ae3e89-b29f-4efc-805c-18268637e972 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Request method failure captured: Apr 21 15:44:34 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3 HTTP/1.1 Apr 21 15:44:34 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:44:34 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:44:34 user devstack@n-api.service[61510]: Connection: close Apr 21 15:44:34 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:44:34 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:44:34 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:44:34 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:44:34 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQq67k5OzpabRUhwBjROgQzW6ZMTMyqN6T_g_CRNnYwrsFhei_HcvXDYpZiwvlQft-GmQNM-WN65kgj_7hG2ePY9Kx9M_e5Ngdwl0eqsVVYUFgQUeOeJfOUurYcSThH5n9w2qnJqxMVJ4JZ6POwGlIrGMcA_dCxI4bk_vMokxbz0LDS4 Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Project-Id: c72ad1c36d144329b11fa1284f3bfd67 Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Tenant-Id: c72ad1c36d144329b11fa1284f3bfd67 Apr 21 15:44:34 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:44:34 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeTestJSON-1973553730-project-member Apr 21 15:44:34 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:44:34 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:44:34 user devstack@n-api.service[61510]: X-User-Id: aecd98fdee134e4c82e721ee37b67553 Apr 21 15:44:34 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeTestJSON-1973553730-project-member Apr 21 15:44:34 user devstack@n-api.service[61510]: method: > Apr 21 15:44:34 user devstack@n-api.service[61510]: exception: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:44:34 user devstack@n-api.service[61510]: action_args: {'id': '6aee29af-024c-4e5c-a893-87af63214df3'} Apr 21 15:44:34 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:44:34 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:44:34 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-65ae3e89-b29f-4efc-805c-18268637e972 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Returning 404 to user: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:44:34 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-65ae3e89-b29f-4efc-805c-18268637e972 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3" status: 404 len: 111 microversion: 2.1 time: 0.039815 Apr 21 15:44:34 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 135/408] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:44:34 2023] GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:44:34 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-ec19a66f-f724-4473-bbe7-8768bb6fdedf tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '.version_select at 0x7f0c145370a0>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:44:34 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:44:34 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:44:34 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-ec19a66f-f724-4473-bbe7-8768bb6fdedf tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-387472105" status: 202 len: 0 microversion: 2.1 time: 0.028359 Apr 21 15:44:34 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 139/409] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 21 15:44:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-387472105 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:44:35 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=8 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:44:35 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:44:35 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-6b7ef3de-8f57-46af-955a-3d5ae634a45a tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Action: 'create', calling method: .version_select at 0x7f0c146536d0>, body: {"keypair": {"name": "tempest-keypair-1323635470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByFt3wY7lDIo4EhODoz8GIpMglm7wwtZQ7A650a48cjbm3EUnt89BZSVz2VA9kS5l+BcWml2KJumFRWrVmcUvyhlCNLEyqfhdznIDyknysBpLuBPldDqgAhUXMQeS+GWQ=="}} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:44:35 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-6b7ef3de-8f57-46af-955a-3d5ae634a45a tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Getting quotas for project c72ad1c36d144329b11fa1284f3bfd67. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:44:35 user devstack@n-api.service[61512]: DEBUG nova.quota [None req-6b7ef3de-8f57-46af-955a-3d5ae634a45a tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Getting quotas for user aecd98fdee134e4c82e721ee37b67553 and project c72ad1c36d144329b11fa1284f3bfd67. Resources: {'key_pairs'} {{(pid=61512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:44:35 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-6b7ef3de-8f57-46af-955a-3d5ae634a45a tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059682 Apr 21 15:44:35 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 136/410] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:44:35 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 21 15:44:36 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-a9074c22-fb85-47bd-8048-a50d1eb9f4fb tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:44:36 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-a9074c22-fb85-47bd-8048-a50d1eb9f4fb tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: 395173ea-75ed-4ae7-9404-69c612b71ffa] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:44:36 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a9074c22-fb85-47bd-8048-a50d1eb9f4fb tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:44:36 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a9074c22-fb85-47bd-8048-a50d1eb9f4fb tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:44:36 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a9074c22-fb85-47bd-8048-a50d1eb9f4fb tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:44:36 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a9074c22-fb85-47bd-8048-a50d1eb9f4fb tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:44:36 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a9074c22-fb85-47bd-8048-a50d1eb9f4fb tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:44:36 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-a9074c22-fb85-47bd-8048-a50d1eb9f4fb tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:44:36 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-35706664", "imageRef": "0400f7ce-fef2-4cc0-a7c4-49a779b17f92", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7b830168-2361-4af6-82ae-921e5cb3670f"}], "security_groups": [{"name": "tempest-securitygroup--1113699809"}], "key_name": "tempest-keypair-1323635470", "user_data": "}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:44:36 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-a9074c22-fb85-47bd-8048-a50d1eb9f4fb tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87426e3ed6b24719a304a9fffd4521ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f94bc14394246d6b1276f163d904fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:44:36 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-a9074c22-fb85-47bd-8048-a50d1eb9f4fb tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa" status: 200 len: 1536 microversion: 2.1 time: 0.221461 Apr 21 15:44:36 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 136/411] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:44:36 2023] GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa => generated 1536 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:44:36 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] validate_networks() for [('7b830168-2361-4af6-82ae-921e5cb3670f', None, None, None, None, None)] {{(pid=61511) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Flavor limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Image limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Flavor pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Image pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Getting quotas for project c72ad1c36d144329b11fa1284f3bfd67. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Getting quotas for user aecd98fdee134e4c82e721ee37b67553 and project c72ad1c36d144329b11fa1284f3bfd67. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Going to run 1 instances... {{(pid=61511) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:44:37 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 0dec7df6-20c7-4f43-bc19-045f05524003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0400f7ce-fef2-4cc0-a7c4-49a779b17f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:44:37 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-096a9765-c82b-4685-af39-4b9a5acd27a3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.792907 Apr 21 15:44:37 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 140/412] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:44:36 2023] POST /compute/v2.1/servers => generated 400 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:44:37 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-e7fa9231-5f8f-498a-9a45-c146f7d78ed3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:44:37 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-e7fa9231-5f8f-498a-9a45-c146f7d78ed3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 0dec7df6-20c7-4f43-bc19-045f05524003] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:44:37 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-e7fa9231-5f8f-498a-9a45-c146f7d78ed3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecd98fdee134e4c82e721ee37b67553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72ad1c36d144329b11fa1284f3bfd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:44:37 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-e7fa9231-5f8f-498a-9a45-c146f7d78ed3 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003" status: 200 len: 1230 microversion: 2.1 time: 0.074178 Apr 21 15:44:37 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 137/413] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:44:37 2023] GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003 => generated 1230 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:44:40 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-099bfae4-e8ac-4e39-bb15-2e78c180060a req-7e3b3b08-f667-45c0-a2f6-f1035f449a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dec7df6-20c7-4f43-bc19-045f05524003", "tag": "dbe231c6-4731-4c8a-bb49-0df0ea1631a8"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:44:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-099bfae4-e8ac-4e39-bb15-2e78c180060a req-7e3b3b08-f667-45c0-a2f6-f1035f449a95 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:44:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-099bfae4-e8ac-4e39-bb15-2e78c180060a req-7e3b3b08-f667-45c0-a2f6-f1035f449a95 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:44:40 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-099bfae4-e8ac-4e39-bb15-2e78c180060a req-7e3b3b08-f667-45c0-a2f6-f1035f449a95 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:44:40 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-099bfae4-e8ac-4e39-bb15-2e78c180060a req-7e3b3b08-f667-45c0-a2f6-f1035f449a95 service nova] Creating event network-changed:dbe231c6-4731-4c8a-bb49-0df0ea1631a8 for instance 0dec7df6-20c7-4f43-bc19-045f05524003 on user Apr 21 15:44:40 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-099bfae4-e8ac-4e39-bb15-2e78c180060a req-7e3b3b08-f667-45c0-a2f6-f1035f449a95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027523 Apr 21 15:44:40 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 137/414] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:44:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:44:42 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-1305cfa8-0c5b-4206-9bc6-a41c11104f39 req-c28e995d-8c4d-4eaf-af97-e2d1594c04eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dec7df6-20c7-4f43-bc19-045f05524003", "name": "network-vif-plugged", "status": "completed", "tag": "dbe231c6-4731-4c8a-bb49-0df0ea1631a8"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:44:42 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-1305cfa8-0c5b-4206-9bc6-a41c11104f39 req-c28e995d-8c4d-4eaf-af97-e2d1594c04eb service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:44:42 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-1305cfa8-0c5b-4206-9bc6-a41c11104f39 req-c28e995d-8c4d-4eaf-af97-e2d1594c04eb service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:44:42 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-1305cfa8-0c5b-4206-9bc6-a41c11104f39 req-c28e995d-8c4d-4eaf-af97-e2d1594c04eb service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:44:42 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-1305cfa8-0c5b-4206-9bc6-a41c11104f39 req-c28e995d-8c4d-4eaf-af97-e2d1594c04eb service nova] Creating event network-vif-plugged:dbe231c6-4731-4c8a-bb49-0df0ea1631a8 for instance 0dec7df6-20c7-4f43-bc19-045f05524003 on user Apr 21 15:44:42 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-1305cfa8-0c5b-4206-9bc6-a41c11104f39 req-c28e995d-8c4d-4eaf-af97-e2d1594c04eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210216 Apr 21 15:44:42 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 141/415] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:44:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:44:44 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-bd69cb33-c57d-4d2f-9485-d5c42f9238bd req-c3f31dc2-815b-4f7c-afa8-42af5e535611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dec7df6-20c7-4f43-bc19-045f05524003", "name": "network-vif-plugged", "status": "completed", "tag": "dbe231c6-4731-4c8a-bb49-0df0ea1631a8"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:44:44 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-bd69cb33-c57d-4d2f-9485-d5c42f9238bd req-c3f31dc2-815b-4f7c-afa8-42af5e535611 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:44:44 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-bd69cb33-c57d-4d2f-9485-d5c42f9238bd req-c3f31dc2-815b-4f7c-afa8-42af5e535611 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:44:44 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-bd69cb33-c57d-4d2f-9485-d5c42f9238bd req-c3f31dc2-815b-4f7c-afa8-42af5e535611 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:44:44 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-bd69cb33-c57d-4d2f-9485-d5c42f9238bd req-c3f31dc2-815b-4f7c-afa8-42af5e535611 service nova] Creating event network-vif-plugged:dbe231c6-4731-4c8a-bb49-0df0ea1631a8 for instance 0dec7df6-20c7-4f43-bc19-045f05524003 on user Apr 21 15:44:44 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-bd69cb33-c57d-4d2f-9485-d5c42f9238bd req-c3f31dc2-815b-4f7c-afa8-42af5e535611 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030493 Apr 21 15:44:44 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 138/416] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:44:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:45:27 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:45:27 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=10 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:45:27 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-3439ae95-b95c-40b5-8f2c-fcf4ff81c195 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:45:27 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-3439ae95-b95c-40b5-8f2c-fcf4ff81c195 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 0dec7df6-20c7-4f43-bc19-045f05524003] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:45:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3439ae95-b95c-40b5-8f2c-fcf4ff81c195 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3439ae95-b95c-40b5-8f2c-fcf4ff81c195 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3439ae95-b95c-40b5-8f2c-fcf4ff81c195 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3439ae95-b95c-40b5-8f2c-fcf4ff81c195 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3439ae95-b95c-40b5-8f2c-fcf4ff81c195 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:27 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-3439ae95-b95c-40b5-8f2c-fcf4ff81c195 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:27 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-3439ae95-b95c-40b5-8f2c-fcf4ff81c195 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecd98fdee134e4c82e721ee37b67553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72ad1c36d144329b11fa1284f3bfd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:45:27 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-3439ae95-b95c-40b5-8f2c-fcf4ff81c195 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003" status: 200 len: 1537 microversion: 2.1 time: 0.235125 Apr 21 15:45:27 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 138/417] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:45:27 2023] GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003 => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:45:36 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:45:36 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:45:36 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:45:36 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=4 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:45:36 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-2025cb7e-6048-4f1d-8362-8e4a6bcb66a8 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:45:36 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-2025cb7e-6048-4f1d-8362-8e4a6bcb66a8 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: 395173ea-75ed-4ae7-9404-69c612b71ffa] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:45:36 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2025cb7e-6048-4f1d-8362-8e4a6bcb66a8 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:36 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2025cb7e-6048-4f1d-8362-8e4a6bcb66a8 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:36 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2025cb7e-6048-4f1d-8362-8e4a6bcb66a8 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:36 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2025cb7e-6048-4f1d-8362-8e4a6bcb66a8 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:36 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2025cb7e-6048-4f1d-8362-8e4a6bcb66a8 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:36 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-2025cb7e-6048-4f1d-8362-8e4a6bcb66a8 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:37 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-2025cb7e-6048-4f1d-8362-8e4a6bcb66a8 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87426e3ed6b24719a304a9fffd4521ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f94bc14394246d6b1276f163d904fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:45:37 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-2025cb7e-6048-4f1d-8362-8e4a6bcb66a8 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa" status: 200 len: 1536 microversion: 2.1 time: 0.230189 Apr 21 15:45:37 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 142/418] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:45:36 2023] GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa => generated 1536 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=6 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-e6932d86-8238-4124-a966-2dff43df5acc tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-e6932d86-8238-4124-a966-2dff43df5acc tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87426e3ed6b24719a304a9fffd4521ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f94bc14394246d6b1276f163d904fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-e6932d86-8238-4124-a966-2dff43df5acc tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Searching by: {'deleted': False, 'project_id': '4f94bc14394246d6b1276f163d904fcb'} {{(pid=61512) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-e6932d86-8238-4124-a966-2dff43df5acc tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-e6932d86-8238-4124-a966-2dff43df5acc tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-e6932d86-8238-4124-a966-2dff43df5acc tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-e6932d86-8238-4124-a966-2dff43df5acc tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-e6932d86-8238-4124-a966-2dff43df5acc tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-e6932d86-8238-4124-a966-2dff43df5acc tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:37 user devstack@n-api.service[61512]: DEBUG nova.compute.multi_cell_list [None req-e6932d86-8238-4124-a966-2dff43df5acc tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 21 15:45:37 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-e6932d86-8238-4124-a966-2dff43df5acc tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.223904 Apr 21 15:45:37 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 139/419] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 21 15:45:37 2023] GET /compute/v2.1/servers => generated 341 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:45:37 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-be771169-0426-4e20-8619-cdaa034cefe5 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:45:37 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-be771169-0426-4e20-8619-cdaa034cefe5 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: 395173ea-75ed-4ae7-9404-69c612b71ffa] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:45:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-be771169-0426-4e20-8619-cdaa034cefe5 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-be771169-0426-4e20-8619-cdaa034cefe5 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-be771169-0426-4e20-8619-cdaa034cefe5 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-be771169-0426-4e20-8619-cdaa034cefe5 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-be771169-0426-4e20-8619-cdaa034cefe5 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:37 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-be771169-0426-4e20-8619-cdaa034cefe5 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:37 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-be771169-0426-4e20-8619-cdaa034cefe5 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87426e3ed6b24719a304a9fffd4521ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f94bc14394246d6b1276f163d904fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:45:37 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-be771169-0426-4e20-8619-cdaa034cefe5 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa" status: 200 len: 1536 microversion: 2.1 time: 0.220982 Apr 21 15:45:37 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 139/420] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:45:37 2023] GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa => generated 1536 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:45:39 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-beb7952f-3b70-46fa-b5e3-79155040afa1 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:45:39 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-beb7952f-3b70-46fa-b5e3-79155040afa1 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: 395173ea-75ed-4ae7-9404-69c612b71ffa] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:45:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-beb7952f-3b70-46fa-b5e3-79155040afa1 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-beb7952f-3b70-46fa-b5e3-79155040afa1 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-beb7952f-3b70-46fa-b5e3-79155040afa1 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-beb7952f-3b70-46fa-b5e3-79155040afa1 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-beb7952f-3b70-46fa-b5e3-79155040afa1 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:39 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-beb7952f-3b70-46fa-b5e3-79155040afa1 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:39 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-beb7952f-3b70-46fa-b5e3-79155040afa1 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: 395173ea-75ed-4ae7-9404-69c612b71ffa] Going to try to terminate instance {{(pid=61511) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:45:39 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-beb7952f-3b70-46fa-b5e3-79155040afa1 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa" status: 204 len: 0 microversion: 2.1 time: 0.114899 Apr 21 15:45:39 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 143/421] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:45:39 2023] DELETE /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:45:39 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-6fd8a757-50fa-4b00-96d5-dad8c0518112 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:45:39 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-6fd8a757-50fa-4b00-96d5-dad8c0518112 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: 395173ea-75ed-4ae7-9404-69c612b71ffa] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:45:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6fd8a757-50fa-4b00-96d5-dad8c0518112 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6fd8a757-50fa-4b00-96d5-dad8c0518112 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6fd8a757-50fa-4b00-96d5-dad8c0518112 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6fd8a757-50fa-4b00-96d5-dad8c0518112 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6fd8a757-50fa-4b00-96d5-dad8c0518112 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-6fd8a757-50fa-4b00-96d5-dad8c0518112 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:39 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-168f591b-eb5b-4397-aec2-199207b09b59 req-3a65a4df-5b87-47fb-930b-9de3ab3ccecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395173ea-75ed-4ae7-9404-69c612b71ffa", "name": "network-vif-unplugged", "status": "completed", "tag": "4d4c4504-7ec7-431f-9ff2-47ed79510c5a"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:45:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-168f591b-eb5b-4397-aec2-199207b09b59 req-3a65a4df-5b87-47fb-930b-9de3ab3ccecb service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-168f591b-eb5b-4397-aec2-199207b09b59 req-3a65a4df-5b87-47fb-930b-9de3ab3ccecb service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:39 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-168f591b-eb5b-4397-aec2-199207b09b59 req-3a65a4df-5b87-47fb-930b-9de3ab3ccecb service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-168f591b-eb5b-4397-aec2-199207b09b59 req-3a65a4df-5b87-47fb-930b-9de3ab3ccecb service nova] Creating event network-vif-unplugged:4d4c4504-7ec7-431f-9ff2-47ed79510c5a for instance 395173ea-75ed-4ae7-9404-69c612b71ffa on user Apr 21 15:45:39 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-168f591b-eb5b-4397-aec2-199207b09b59 req-3a65a4df-5b87-47fb-930b-9de3ab3ccecb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027700 Apr 21 15:45:39 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 140/422] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:45:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:45:39 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-6fd8a757-50fa-4b00-96d5-dad8c0518112 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87426e3ed6b24719a304a9fffd4521ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f94bc14394246d6b1276f163d904fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:45:39 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-6fd8a757-50fa-4b00-96d5-dad8c0518112 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa" status: 200 len: 1542 microversion: 2.1 time: 0.278540 Apr 21 15:45:39 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 140/423] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:45:39 2023] GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa => generated 1542 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:45:40 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-540afcf2-385f-4d93-b404-12fa684ab435 req-4a9a59ee-d537-49ae-9e5a-a29fb80eede1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395173ea-75ed-4ae7-9404-69c612b71ffa", "name": "network-vif-deleted", "tag": "4d4c4504-7ec7-431f-9ff2-47ed79510c5a"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:45:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-540afcf2-385f-4d93-b404-12fa684ab435 req-4a9a59ee-d537-49ae-9e5a-a29fb80eede1 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-540afcf2-385f-4d93-b404-12fa684ab435 req-4a9a59ee-d537-49ae-9e5a-a29fb80eede1 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:40 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-540afcf2-385f-4d93-b404-12fa684ab435 req-4a9a59ee-d537-49ae-9e5a-a29fb80eede1 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:40 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-540afcf2-385f-4d93-b404-12fa684ab435 req-4a9a59ee-d537-49ae-9e5a-a29fb80eede1 service nova] Creating event network-vif-deleted:4d4c4504-7ec7-431f-9ff2-47ed79510c5a for instance 395173ea-75ed-4ae7-9404-69c612b71ffa on user Apr 21 15:45:40 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-540afcf2-385f-4d93-b404-12fa684ab435 req-4a9a59ee-d537-49ae-9e5a-a29fb80eede1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028355 Apr 21 15:45:40 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 144/424] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:45:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:45:41 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-5390089d-5894-4422-b577-a0aaa0b0401b req-ac799ecc-5b38-4722-bd6d-59c6d7767845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395173ea-75ed-4ae7-9404-69c612b71ffa", "name": "network-vif-plugged", "status": "completed", "tag": "4d4c4504-7ec7-431f-9ff2-47ed79510c5a"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:45:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-5390089d-5894-4422-b577-a0aaa0b0401b req-ac799ecc-5b38-4722-bd6d-59c6d7767845 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:45:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-5390089d-5894-4422-b577-a0aaa0b0401b req-ac799ecc-5b38-4722-bd6d-59c6d7767845 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:45:41 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-5390089d-5894-4422-b577-a0aaa0b0401b req-ac799ecc-5b38-4722-bd6d-59c6d7767845 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:45:41 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-5390089d-5894-4422-b577-a0aaa0b0401b req-ac799ecc-5b38-4722-bd6d-59c6d7767845 service nova] Creating event network-vif-plugged:4d4c4504-7ec7-431f-9ff2-47ed79510c5a for instance 395173ea-75ed-4ae7-9404-69c612b71ffa on user Apr 21 15:45:41 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-5390089d-5894-4422-b577-a0aaa0b0401b req-ac799ecc-5b38-4722-bd6d-59c6d7767845 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030425 Apr 21 15:45:41 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 141/425] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:45:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:46:27 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-36264526-8c41-4cbd-9c9e-4338d7baf5e0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:46:27 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-36264526-8c41-4cbd-9c9e-4338d7baf5e0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 0dec7df6-20c7-4f43-bc19-045f05524003] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:46:27 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:46:27 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:46:27 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=14 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:46:27 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-36264526-8c41-4cbd-9c9e-4338d7baf5e0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:27 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-36264526-8c41-4cbd-9c9e-4338d7baf5e0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:27 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-36264526-8c41-4cbd-9c9e-4338d7baf5e0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:27 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-36264526-8c41-4cbd-9c9e-4338d7baf5e0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:27 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-36264526-8c41-4cbd-9c9e-4338d7baf5e0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:27 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-36264526-8c41-4cbd-9c9e-4338d7baf5e0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:28 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-36264526-8c41-4cbd-9c9e-4338d7baf5e0 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.166101 Apr 21 15:46:28 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 141/426] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 21 15:46:27 2023] GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003/os-interface => generated 283 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:46:28 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:46:28 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:46:28 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-6f6ef2f9-f3c4-45ea-b5c9-480499bea913 req-acde4acf-5c4d-4eb9-a480-15f1cb306f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dec7df6-20c7-4f43-bc19-045f05524003", "tag": "dbe231c6-4731-4c8a-bb49-0df0ea1631a8"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:46:28 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-6f6ef2f9-f3c4-45ea-b5c9-480499bea913 req-acde4acf-5c4d-4eb9-a480-15f1cb306f16 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:28 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-6f6ef2f9-f3c4-45ea-b5c9-480499bea913 req-acde4acf-5c4d-4eb9-a480-15f1cb306f16 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:28 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-6f6ef2f9-f3c4-45ea-b5c9-480499bea913 req-acde4acf-5c4d-4eb9-a480-15f1cb306f16 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:28 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-6f6ef2f9-f3c4-45ea-b5c9-480499bea913 req-acde4acf-5c4d-4eb9-a480-15f1cb306f16 service nova] Creating event network-changed:dbe231c6-4731-4c8a-bb49-0df0ea1631a8 for instance 0dec7df6-20c7-4f43-bc19-045f05524003 on user Apr 21 15:46:28 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-6f6ef2f9-f3c4-45ea-b5c9-480499bea913 req-acde4acf-5c4d-4eb9-a480-15f1cb306f16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038801 Apr 21 15:46:28 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 145/427] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:46:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:46:28 user devstack@n-api.service[61510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 15:46:28 user devstack@n-api.service[61510]: Fri Apr 21 15:46:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003/ips (ip 10.0.0.210) !!! Apr 21 15:46:28 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=8 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:46:28 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=16 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:46:28 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-9b6a47b9-4613-4a84-b387-67d064d0bccb tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:46:28 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-9b6a47b9-4613-4a84-b387-67d064d0bccb tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 0dec7df6-20c7-4f43-bc19-045f05524003] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:46:28 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9b6a47b9-4613-4a84-b387-67d064d0bccb tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:28 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9b6a47b9-4613-4a84-b387-67d064d0bccb tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:28 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9b6a47b9-4613-4a84-b387-67d064d0bccb tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:28 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9b6a47b9-4613-4a84-b387-67d064d0bccb tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:28 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9b6a47b9-4613-4a84-b387-67d064d0bccb tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:28 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-9b6a47b9-4613-4a84-b387-67d064d0bccb tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:28 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-9b6a47b9-4613-4a84-b387-67d064d0bccb tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003/ips" status: 200 len: 105 microversion: 2.1 time: 0.045240 Apr 21 15:46:28 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 142/428] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 21 15:46:28 2023] GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003/ips => generated 105 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:46:29 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-1f4f4201-5090-4a3e-80b4-e84d09a9c485 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:46:29 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-1f4f4201-5090-4a3e-80b4-e84d09a9c485 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: 395173ea-75ed-4ae7-9404-69c612b71ffa] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:46:29 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1f4f4201-5090-4a3e-80b4-e84d09a9c485 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:29 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1f4f4201-5090-4a3e-80b4-e84d09a9c485 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:29 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1f4f4201-5090-4a3e-80b4-e84d09a9c485 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:29 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1f4f4201-5090-4a3e-80b4-e84d09a9c485 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:29 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1f4f4201-5090-4a3e-80b4-e84d09a9c485 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:29 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1f4f4201-5090-4a3e-80b4-e84d09a9c485 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:29 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-1f4f4201-5090-4a3e-80b4-e84d09a9c485 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] HTTP exception thrown: Instance 395173ea-75ed-4ae7-9404-69c612b71ffa could not be found. Apr 21 15:46:29 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-1f4f4201-5090-4a3e-80b4-e84d09a9c485 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Request method failure captured: Apr 21 15:46:29 user devstack@n-api.service[61512]: request: GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa HTTP/1.1 Apr 21 15:46:29 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:46:29 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:46:29 user devstack@n-api.service[61512]: Connection: close Apr 21 15:46:29 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:46:29 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:46:29 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:46:29 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:46:29 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQq8oao_QCz0lLayBPZdk0jYWlv6ftz5j2nymu7swmbjbQj2LDLUvKaw54am1pjFELEKNymXcfMlMv5MuKaCPn7hnnCanm2JFOuoVKOWm3nul_no_urpP7HMUB6WneertGymZ6_EGyseqxjhhdf2-nhCmO52_ZLsXfVDk1wJQFawffPQ Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Project-Id: 4f94bc14394246d6b1276f163d904fcb Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Project-Name: tempest-TestMinimumBasicScenario-1717654390 Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f94bc14394246d6b1276f163d904fcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f94bc14394246d6b1276f163d904fcb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f94bc14394246d6b1276f163d904fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Tenant: tempest-TestMinimumBasicScenario-1717654390 Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Tenant-Id: 4f94bc14394246d6b1276f163d904fcb Apr 21 15:46:29 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1717654390 Apr 21 15:46:29 user devstack@n-api.service[61512]: X-User: tempest-TestMinimumBasicScenario-1717654390-project-member Apr 21 15:46:29 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:46:29 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:46:29 user devstack@n-api.service[61512]: X-User-Id: 87426e3ed6b24719a304a9fffd4521ae Apr 21 15:46:29 user devstack@n-api.service[61512]: X-User-Name: tempest-TestMinimumBasicScenario-1717654390-project-member Apr 21 15:46:29 user devstack@n-api.service[61512]: method: > Apr 21 15:46:29 user devstack@n-api.service[61512]: exception: Instance 395173ea-75ed-4ae7-9404-69c612b71ffa could not be found. Apr 21 15:46:29 user devstack@n-api.service[61512]: action_args: {'id': '395173ea-75ed-4ae7-9404-69c612b71ffa'} Apr 21 15:46:29 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 395173ea-75ed-4ae7-9404-69c612b71ffa could not be found. Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 395173ea-75ed-4ae7-9404-69c612b71ffa could not be found. Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 395173ea-75ed-4ae7-9404-69c612b71ffa could not be found. Apr 21 15:46:29 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:46:29 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-1f4f4201-5090-4a3e-80b4-e84d09a9c485 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Returning 404 to user: Instance 395173ea-75ed-4ae7-9404-69c612b71ffa could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:46:29 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-1f4f4201-5090-4a3e-80b4-e84d09a9c485 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa" status: 404 len: 111 microversion: 2.1 time: 0.032445 Apr 21 15:46:29 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 142/429] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:46:29 2023] GET /compute/v2.1/servers/395173ea-75ed-4ae7-9404-69c612b71ffa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:46:29 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-a4798c6d-7c09-4a63-9518-c420c70c3874 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '.version_select at 0x7f0c14536dd0>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:46:29 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-a4798c6d-7c09-4a63-9518-c420c70c3874 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-204054769" status: 202 len: 0 microversion: 2.1 time: 0.024041 Apr 21 15:46:29 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 146/430] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 21 15:46:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-204054769 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:46:30 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-7cad6132-c532-4abc-9fd3-b66d130721e4 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:46:30 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-7cad6132-c532-4abc-9fd3-b66d130721e4 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 0dec7df6-20c7-4f43-bc19-045f05524003] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:46:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-7cad6132-c532-4abc-9fd3-b66d130721e4 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-7cad6132-c532-4abc-9fd3-b66d130721e4 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-7cad6132-c532-4abc-9fd3-b66d130721e4 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-7cad6132-c532-4abc-9fd3-b66d130721e4 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-7cad6132-c532-4abc-9fd3-b66d130721e4 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:30 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-7cad6132-c532-4abc-9fd3-b66d130721e4 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:30 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-7cad6132-c532-4abc-9fd3-b66d130721e4 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 0dec7df6-20c7-4f43-bc19-045f05524003] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:46:30 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-7cad6132-c532-4abc-9fd3-b66d130721e4 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003" status: 204 len: 0 microversion: 2.1 time: 0.106081 Apr 21 15:46:30 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 143/431] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:46:30 2023] DELETE /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:46:30 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-4e8feed3-e981-4a82-b573-aef12eb7a3aa tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:46:30 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-4e8feed3-e981-4a82-b573-aef12eb7a3aa tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 0dec7df6-20c7-4f43-bc19-045f05524003] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:46:30 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4e8feed3-e981-4a82-b573-aef12eb7a3aa tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:30 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4e8feed3-e981-4a82-b573-aef12eb7a3aa tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:30 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4e8feed3-e981-4a82-b573-aef12eb7a3aa tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:30 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4e8feed3-e981-4a82-b573-aef12eb7a3aa tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:30 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4e8feed3-e981-4a82-b573-aef12eb7a3aa tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:30 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-4e8feed3-e981-4a82-b573-aef12eb7a3aa tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:30 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-4e8feed3-e981-4a82-b573-aef12eb7a3aa tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aecd98fdee134e4c82e721ee37b67553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72ad1c36d144329b11fa1284f3bfd67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:46:30 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-4e8feed3-e981-4a82-b573-aef12eb7a3aa tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003" status: 200 len: 1662 microversion: 2.1 time: 0.288057 Apr 21 15:46:30 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 143/432] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:46:30 2023] GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003 => generated 1662 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:46:30 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-a3effbad-2ed5-4f0d-81ed-915508248c06 req-ed737468-f51a-4573-8469-52ad606ee810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dec7df6-20c7-4f43-bc19-045f05524003", "name": "network-vif-unplugged", "status": "completed", "tag": "dbe231c6-4731-4c8a-bb49-0df0ea1631a8"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:46:30 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-a3effbad-2ed5-4f0d-81ed-915508248c06 req-ed737468-f51a-4573-8469-52ad606ee810 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:30 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-a3effbad-2ed5-4f0d-81ed-915508248c06 req-ed737468-f51a-4573-8469-52ad606ee810 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:30 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-a3effbad-2ed5-4f0d-81ed-915508248c06 req-ed737468-f51a-4573-8469-52ad606ee810 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:30 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-a3effbad-2ed5-4f0d-81ed-915508248c06 req-ed737468-f51a-4573-8469-52ad606ee810 service nova] Creating event network-vif-unplugged:dbe231c6-4731-4c8a-bb49-0df0ea1631a8 for instance 0dec7df6-20c7-4f43-bc19-045f05524003 on user Apr 21 15:46:30 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-a3effbad-2ed5-4f0d-81ed-915508248c06 req-ed737468-f51a-4573-8469-52ad606ee810 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028112 Apr 21 15:46:30 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 147/433] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:46:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:46:32 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-458d4560-b35c-4f8a-8a91-7fba285ec0ad tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Action: 'create', calling method: .version_select at 0x7f0c146c6d40>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-652457593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLK5MJqAsI8GDNmwTC6LfIctxZkpImdRewqX6e+ac39z3Q2/WvNLjTYgmiZCaJEDM4bBgTTxtqaxuvbnVzAepeE+d+KDmyj93CRJNXkZ8KjqGPAg+JSk2cErgijpEsQOCw=="}} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:46:32 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-458d4560-b35c-4f8a-8a91-7fba285ec0ad tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Getting quotas for project 4f94bc14394246d6b1276f163d904fcb. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:46:32 user devstack@n-api.service[61510]: DEBUG nova.quota [None req-458d4560-b35c-4f8a-8a91-7fba285ec0ad tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Getting quotas for user 87426e3ed6b24719a304a9fffd4521ae and project 4f94bc14394246d6b1276f163d904fcb. Resources: {'key_pairs'} {{(pid=61510) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:46:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-458d4560-b35c-4f8a-8a91-7fba285ec0ad tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049200 Apr 21 15:46:32 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 144/434] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:46:32 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:46:32 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-22c1ad8e-ce82-4d77-bbed-2cf30fa9b786 req-263c6587-bd5a-41b9-bb5b-162469f89f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dec7df6-20c7-4f43-bc19-045f05524003", "name": "network-vif-deleted", "tag": "dbe231c6-4731-4c8a-bb49-0df0ea1631a8"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:46:32 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-22c1ad8e-ce82-4d77-bbed-2cf30fa9b786 req-263c6587-bd5a-41b9-bb5b-162469f89f77 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:32 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-22c1ad8e-ce82-4d77-bbed-2cf30fa9b786 req-263c6587-bd5a-41b9-bb5b-162469f89f77 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:32 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-22c1ad8e-ce82-4d77-bbed-2cf30fa9b786 req-263c6587-bd5a-41b9-bb5b-162469f89f77 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:32 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-22c1ad8e-ce82-4d77-bbed-2cf30fa9b786 req-263c6587-bd5a-41b9-bb5b-162469f89f77 service nova] Creating event network-vif-deleted:dbe231c6-4731-4c8a-bb49-0df0ea1631a8 for instance 0dec7df6-20c7-4f43-bc19-045f05524003 on user Apr 21 15:46:32 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-22c1ad8e-ce82-4d77-bbed-2cf30fa9b786 req-263c6587-bd5a-41b9-bb5b-162469f89f77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033128 Apr 21 15:46:32 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 144/435] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:46:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-460512665", "imageRef": "17ce0c22-5524-49cb-acbf-3bb6f826553f", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-652457593", "networks": [{"uuid": "cda34f8a-2ac2-4191-921f-ce37a1ff0a64"}]}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG nova.network.neutron [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] validate_networks() for [('cda34f8a-2ac2-4191-921f-ce37a1ff0a64', None, None, None, None, None)] {{(pid=61511) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 21 15:46:32 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-767c6b3c-6cde-44dc-a3c7-6a4b864fb4d5 req-a478b1c2-4982-4711-8e6f-1c3ac5337ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dec7df6-20c7-4f43-bc19-045f05524003", "name": "network-vif-plugged", "status": "completed", "tag": "dbe231c6-4731-4c8a-bb49-0df0ea1631a8"}, {"server_uuid": "0dec7df6-20c7-4f43-bc19-045f05524003", "name": "network-vif-plugged", "status": "completed", "tag": "dbe231c6-4731-4c8a-bb49-0df0ea1631a8"}, {"server_uuid": "0dec7df6-20c7-4f43-bc19-045f05524003", "name": "network-vif-plugged", "status": "completed", "tag": "dbe231c6-4731-4c8a-bb49-0df0ea1631a8"}, {"server_uuid": "0dec7df6-20c7-4f43-bc19-045f05524003", "name": "network-vif-unplugged", "status": "completed", "tag": "dbe231c6-4731-4c8a-bb49-0df0ea1631a8"}, {"server_uuid": "0dec7df6-20c7-4f43-bc19-045f05524003", "name": "network-vif-plugged", "status": "completed", "tag": "dbe231c6-4731-4c8a-bb49-0df0ea1631a8"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:46:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-767c6b3c-6cde-44dc-a3c7-6a4b864fb4d5 req-a478b1c2-4982-4711-8e6f-1c3ac5337ac3 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-767c6b3c-6cde-44dc-a3c7-6a4b864fb4d5 req-a478b1c2-4982-4711-8e6f-1c3ac5337ac3 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:32 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-767c6b3c-6cde-44dc-a3c7-6a4b864fb4d5 req-a478b1c2-4982-4711-8e6f-1c3ac5337ac3 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-767c6b3c-6cde-44dc-a3c7-6a4b864fb4d5 req-a478b1c2-4982-4711-8e6f-1c3ac5337ac3 service nova] Creating event network-vif-plugged:dbe231c6-4731-4c8a-bb49-0df0ea1631a8 for instance 0dec7df6-20c7-4f43-bc19-045f05524003 on user Apr 21 15:46:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-767c6b3c-6cde-44dc-a3c7-6a4b864fb4d5 req-a478b1c2-4982-4711-8e6f-1c3ac5337ac3 service nova] Creating event network-vif-plugged:dbe231c6-4731-4c8a-bb49-0df0ea1631a8 for instance 0dec7df6-20c7-4f43-bc19-045f05524003 on user Apr 21 15:46:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-767c6b3c-6cde-44dc-a3c7-6a4b864fb4d5 req-a478b1c2-4982-4711-8e6f-1c3ac5337ac3 service nova] Creating event network-vif-plugged:dbe231c6-4731-4c8a-bb49-0df0ea1631a8 for instance 0dec7df6-20c7-4f43-bc19-045f05524003 on user Apr 21 15:46:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-767c6b3c-6cde-44dc-a3c7-6a4b864fb4d5 req-a478b1c2-4982-4711-8e6f-1c3ac5337ac3 service nova] Creating event network-vif-unplugged:dbe231c6-4731-4c8a-bb49-0df0ea1631a8 for instance 0dec7df6-20c7-4f43-bc19-045f05524003 on user Apr 21 15:46:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-767c6b3c-6cde-44dc-a3c7-6a4b864fb4d5 req-a478b1c2-4982-4711-8e6f-1c3ac5337ac3 service nova] Creating event network-vif-plugged:dbe231c6-4731-4c8a-bb49-0df0ea1631a8 for instance 0dec7df6-20c7-4f43-bc19-045f05524003 on user Apr 21 15:46:32 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-767c6b3c-6cde-44dc-a3c7-6a4b864fb4d5 req-a478b1c2-4982-4711-8e6f-1c3ac5337ac3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034806 Apr 21 15:46:32 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 145/436] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:46:32 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Flavor limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Image limits 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Flavor pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Image pref 0:0:0 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG nova.virt.hardware [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Getting quotas for project 4f94bc14394246d6b1276f163d904fcb. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Getting quotas for user 87426e3ed6b24719a304a9fffd4521ae and project 4f94bc14394246d6b1276f163d904fcb. Resources: {'ram', 'cores', 'instances'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Going to run 1 instances... {{(pid=61511) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 21 15:46:32 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: e429c426-49b3-40ab-bb9c-a37e7496b04d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17ce0c22-5524-49cb-acbf-3bb6f826553f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 21 15:46:32 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-514fd0e8-d41f-499c-9525-5f322bec7194 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.631321 Apr 21 15:46:32 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 148/437] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 21 15:46:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 21 15:46:32 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-0104f1f9-ebc1-4b62-bfe0-bdeabecaf143 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:46:32 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-0104f1f9-ebc1-4b62-bfe0-bdeabecaf143 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: e429c426-49b3-40ab-bb9c-a37e7496b04d] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:46:33 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-0104f1f9-ebc1-4b62-bfe0-bdeabecaf143 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87426e3ed6b24719a304a9fffd4521ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f94bc14394246d6b1276f163d904fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:46:33 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-0104f1f9-ebc1-4b62-bfe0-bdeabecaf143 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d" status: 200 len: 1251 microversion: 2.1 time: 0.081257 Apr 21 15:46:33 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 145/438] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:46:32 2023] GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d => generated 1251 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:46:35 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-fddc796f-bf6c-4411-a308-e4ae8e817339 req-ccaa7e58-0f02-489d-8201-871ab81baa5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e429c426-49b3-40ab-bb9c-a37e7496b04d", "tag": "3e80791d-05df-4a2f-82f7-d2ee2c5a15ad"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:46:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-fddc796f-bf6c-4411-a308-e4ae8e817339 req-ccaa7e58-0f02-489d-8201-871ab81baa5f service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-fddc796f-bf6c-4411-a308-e4ae8e817339 req-ccaa7e58-0f02-489d-8201-871ab81baa5f service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:35 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-fddc796f-bf6c-4411-a308-e4ae8e817339 req-ccaa7e58-0f02-489d-8201-871ab81baa5f service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-fddc796f-bf6c-4411-a308-e4ae8e817339 req-ccaa7e58-0f02-489d-8201-871ab81baa5f service nova] Creating event network-changed:3e80791d-05df-4a2f-82f7-d2ee2c5a15ad for instance e429c426-49b3-40ab-bb9c-a37e7496b04d on user Apr 21 15:46:35 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-fddc796f-bf6c-4411-a308-e4ae8e817339 req-ccaa7e58-0f02-489d-8201-871ab81baa5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035453 Apr 21 15:46:35 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 146/439] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:46:37 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-ef53c4bb-2fd7-46f4-a1ea-8fcb29f6d8c6 req-61e659c2-699c-44e6-b85c-8c5cf7d8001c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e429c426-49b3-40ab-bb9c-a37e7496b04d", "name": "network-vif-plugged", "status": "completed", "tag": "3e80791d-05df-4a2f-82f7-d2ee2c5a15ad"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:46:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-ef53c4bb-2fd7-46f4-a1ea-8fcb29f6d8c6 req-61e659c2-699c-44e6-b85c-8c5cf7d8001c service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-ef53c4bb-2fd7-46f4-a1ea-8fcb29f6d8c6 req-61e659c2-699c-44e6-b85c-8c5cf7d8001c service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:37 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-ef53c4bb-2fd7-46f4-a1ea-8fcb29f6d8c6 req-61e659c2-699c-44e6-b85c-8c5cf7d8001c service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:37 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-ef53c4bb-2fd7-46f4-a1ea-8fcb29f6d8c6 req-61e659c2-699c-44e6-b85c-8c5cf7d8001c service nova] Creating event network-vif-plugged:3e80791d-05df-4a2f-82f7-d2ee2c5a15ad for instance e429c426-49b3-40ab-bb9c-a37e7496b04d on user Apr 21 15:46:37 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-ef53c4bb-2fd7-46f4-a1ea-8fcb29f6d8c6 req-61e659c2-699c-44e6-b85c-8c5cf7d8001c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055704 Apr 21 15:46:37 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 149/440] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:46:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:46:39 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-47862546-b302-4323-8d5f-ad9b03b17135 req-152cd04c-b8ce-4792-bd85-1bc834914260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e429c426-49b3-40ab-bb9c-a37e7496b04d", "name": "network-vif-plugged", "status": "completed", "tag": "3e80791d-05df-4a2f-82f7-d2ee2c5a15ad"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:46:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-47862546-b302-4323-8d5f-ad9b03b17135 req-152cd04c-b8ce-4792-bd85-1bc834914260 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:46:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-47862546-b302-4323-8d5f-ad9b03b17135 req-152cd04c-b8ce-4792-bd85-1bc834914260 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:46:39 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-47862546-b302-4323-8d5f-ad9b03b17135 req-152cd04c-b8ce-4792-bd85-1bc834914260 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:46:39 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-47862546-b302-4323-8d5f-ad9b03b17135 req-152cd04c-b8ce-4792-bd85-1bc834914260 service nova] Creating event network-vif-plugged:3e80791d-05df-4a2f-82f7-d2ee2c5a15ad for instance e429c426-49b3-40ab-bb9c-a37e7496b04d on user Apr 21 15:46:39 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-47862546-b302-4323-8d5f-ad9b03b17135 req-152cd04c-b8ce-4792-bd85-1bc834914260 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037624 Apr 21 15:46:39 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 146/441] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:46:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell0:SELECT=4 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-618e8cfc-e06a-4a84-9edb-900b654307d7 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-618e8cfc-e06a-4a84-9edb-900b654307d7 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 0dec7df6-20c7-4f43-bc19-045f05524003] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-618e8cfc-e06a-4a84-9edb-900b654307d7 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-618e8cfc-e06a-4a84-9edb-900b654307d7 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-618e8cfc-e06a-4a84-9edb-900b654307d7 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-618e8cfc-e06a-4a84-9edb-900b654307d7 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-618e8cfc-e06a-4a84-9edb-900b654307d7 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-618e8cfc-e06a-4a84-9edb-900b654307d7 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:47:20 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-618e8cfc-e06a-4a84-9edb-900b654307d7 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] HTTP exception thrown: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-618e8cfc-e06a-4a84-9edb-900b654307d7 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Request method failure captured: Apr 21 15:47:20 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003 HTTP/1.1 Apr 21 15:47:20 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:47:20 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:47:20 user devstack@n-api.service[61510]: Connection: close Apr 21 15:47:20 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:47:20 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:47:20 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:47:20 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:47:20 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQq67k5OzpabRUhwBjROgQzW6ZMTMyqN6T_g_CRNnYwrsFhei_HcvXDYpZiwvlQft-GmQNM-WN65kgj_7hG2ePY9Kx9M_e5Ngdwl0eqsVVYUFgQUeOeJfOUurYcSThH5n9w2qnJqxMVJ4JZ6POwGlIrGMcA_dCxI4bk_vMokxbz0LDS4 Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Project-Id: c72ad1c36d144329b11fa1284f3bfd67 Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Tenant-Id: c72ad1c36d144329b11fa1284f3bfd67 Apr 21 15:47:20 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:20 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeTestJSON-1973553730-project-member Apr 21 15:47:20 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:47:20 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:47:20 user devstack@n-api.service[61510]: X-User-Id: aecd98fdee134e4c82e721ee37b67553 Apr 21 15:47:20 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeTestJSON-1973553730-project-member Apr 21 15:47:20 user devstack@n-api.service[61510]: method: > Apr 21 15:47:20 user devstack@n-api.service[61510]: exception: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:20 user devstack@n-api.service[61510]: action_args: {'id': '0dec7df6-20c7-4f43-bc19-045f05524003'} Apr 21 15:47:20 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:20 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:47:20 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-618e8cfc-e06a-4a84-9edb-900b654307d7 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Returning 404 to user: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:47:20 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-618e8cfc-e06a-4a84-9edb-900b654307d7 tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003" status: 404 len: 111 microversion: 2.1 time: 0.133091 Apr 21 15:47:20 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 147/442] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:47:20 2023] GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:47:20 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-d1fc078a-cab0-4d6f-adf4-36702d014a9b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '.version_select at 0x7f0c14537880>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:47:20 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:20 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=6 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:20 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:20 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=8 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:20 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-d1fc078a-cab0-4d6f-adf4-36702d014a9b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323635470" status: 202 len: 0 microversion: 2.1 time: 0.032668 Apr 21 15:47:20 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 150/443] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 21 15:47:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323635470 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:47:21 user devstack@n-api.service[61512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 15:47:21 user devstack@n-api.service[61512]: Fri Apr 21 15:47:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003 (ip 10.0.0.210) !!! Apr 21 15:47:21 user devstack@n-api.service[61512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 15:47:21 user devstack@n-api.service[61512]: Fri Apr 21 15:47:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003 (ip 10.0.0.210) !!! Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell0:SELECT=2 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=14 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=16 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-25a1a613-ea2c-41ba-8933-7f2c5df95e7b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-25a1a613-ea2c-41ba-8933-7f2c5df95e7b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 0dec7df6-20c7-4f43-bc19-045f05524003] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-25a1a613-ea2c-41ba-8933-7f2c5df95e7b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-25a1a613-ea2c-41ba-8933-7f2c5df95e7b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-25a1a613-ea2c-41ba-8933-7f2c5df95e7b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-25a1a613-ea2c-41ba-8933-7f2c5df95e7b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-25a1a613-ea2c-41ba-8933-7f2c5df95e7b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-25a1a613-ea2c-41ba-8933-7f2c5df95e7b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:47:21 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-25a1a613-ea2c-41ba-8933-7f2c5df95e7b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] HTTP exception thrown: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-25a1a613-ea2c-41ba-8933-7f2c5df95e7b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Request method failure captured: Apr 21 15:47:21 user devstack@n-api.service[61512]: request: DELETE /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003 HTTP/1.1 Apr 21 15:47:21 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:47:21 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:47:21 user devstack@n-api.service[61512]: Connection: close Apr 21 15:47:21 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:47:21 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:47:21 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:47:21 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:47:21 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQq67k5OzpabRUhwBjROgQzW6ZMTMyqN6T_g_CRNnYwrsFhei_HcvXDYpZiwvlQft-GmQNM-WN65kgj_7hG2ePY9Kx9M_e5Ngdwl0eqsVVYUFgQUeOeJfOUurYcSThH5n9w2qnJqxMVJ4JZ6POwGlIrGMcA_dCxI4bk_vMokxbz0LDS4 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Project-Id: c72ad1c36d144329b11fa1284f3bfd67 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Project-Name: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Tenant: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Tenant-Id: c72ad1c36d144329b11fa1284f3bfd67 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-User: tempest-AttachVolumeTestJSON-1973553730-project-member Apr 21 15:47:21 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:47:21 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:47:21 user devstack@n-api.service[61512]: X-User-Id: aecd98fdee134e4c82e721ee37b67553 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-User-Name: tempest-AttachVolumeTestJSON-1973553730-project-member Apr 21 15:47:21 user devstack@n-api.service[61512]: method: > Apr 21 15:47:21 user devstack@n-api.service[61512]: exception: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61512]: action_args: {'id': '0dec7df6-20c7-4f43-bc19-045f05524003'} Apr 21 15:47:21 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-25a1a613-ea2c-41ba-8933-7f2c5df95e7b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Returning 404 to user: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:47:21 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-25a1a613-ea2c-41ba-8933-7f2c5df95e7b tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003" status: 404 len: 111 microversion: 2.1 time: 0.047515 Apr 21 15:47:21 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 147/444] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:47:21 2023] DELETE /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:47:21 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-fe854f5c-9920-4eb6-85d8-0871c75ebb1d tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:47:21 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-fe854f5c-9920-4eb6-85d8-0871c75ebb1d tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 0dec7df6-20c7-4f43-bc19-045f05524003] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:47:21 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-fe854f5c-9920-4eb6-85d8-0871c75ebb1d tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:47:21 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-fe854f5c-9920-4eb6-85d8-0871c75ebb1d tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:47:21 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-fe854f5c-9920-4eb6-85d8-0871c75ebb1d tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:47:21 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-fe854f5c-9920-4eb6-85d8-0871c75ebb1d tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:47:21 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-fe854f5c-9920-4eb6-85d8-0871c75ebb1d tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:47:21 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-fe854f5c-9920-4eb6-85d8-0871c75ebb1d tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:47:21 user devstack@n-api.service[61510]: INFO nova.api.openstack.wsgi [None req-fe854f5c-9920-4eb6-85d8-0871c75ebb1d tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] HTTP exception thrown: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-fe854f5c-9920-4eb6-85d8-0871c75ebb1d tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Request method failure captured: Apr 21 15:47:21 user devstack@n-api.service[61510]: request: GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003 HTTP/1.1 Apr 21 15:47:21 user devstack@n-api.service[61510]: Accept: application/json Apr 21 15:47:21 user devstack@n-api.service[61510]: Accept-Encoding: identity Apr 21 15:47:21 user devstack@n-api.service[61510]: Connection: close Apr 21 15:47:21 user devstack@n-api.service[61510]: Content-Length: 0 Apr 21 15:47:21 user devstack@n-api.service[61510]: Content-Type: application/json Apr 21 15:47:21 user devstack@n-api.service[61510]: Host: 10.0.0.210 Apr 21 15:47:21 user devstack@n-api.service[61510]: Openstack-System-Scope: None Apr 21 15:47:21 user devstack@n-api.service[61510]: User-Agent: python-urllib3/1.26.15 Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Auth-Token: gAAAAABkQq67k5OzpabRUhwBjROgQzW6ZMTMyqN6T_g_CRNnYwrsFhei_HcvXDYpZiwvlQft-GmQNM-WN65kgj_7hG2ePY9Kx9M_e5Ngdwl0eqsVVYUFgQUeOeJfOUurYcSThH5n9w2qnJqxMVJ4JZ6POwGlIrGMcA_dCxI4bk_vMokxbz0LDS4 Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Domain-Id: None Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Domain-Name: None Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Identity-Status: Confirmed Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Is-Admin-Project: True Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Project-Domain-Id: default Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Project-Domain-Name: Default Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Project-Id: c72ad1c36d144329b11fa1284f3bfd67 Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Project-Name: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Role: reader,member Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Roles: reader,member Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Tenant: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Tenant-Id: c72ad1c36d144329b11fa1284f3bfd67 Apr 21 15:47:21 user devstack@n-api.service[61510]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:21 user devstack@n-api.service[61510]: X-User: tempest-AttachVolumeTestJSON-1973553730-project-member Apr 21 15:47:21 user devstack@n-api.service[61510]: X-User-Domain-Id: default Apr 21 15:47:21 user devstack@n-api.service[61510]: X-User-Domain-Name: Default Apr 21 15:47:21 user devstack@n-api.service[61510]: X-User-Id: aecd98fdee134e4c82e721ee37b67553 Apr 21 15:47:21 user devstack@n-api.service[61510]: X-User-Name: tempest-AttachVolumeTestJSON-1973553730-project-member Apr 21 15:47:21 user devstack@n-api.service[61510]: method: > Apr 21 15:47:21 user devstack@n-api.service[61510]: exception: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61510]: action_args: {'id': '0dec7df6-20c7-4f43-bc19-045f05524003'} Apr 21 15:47:21 user devstack@n-api.service[61510]: {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61510]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-fe854f5c-9920-4eb6-85d8-0871c75ebb1d tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Returning 404 to user: Instance 0dec7df6-20c7-4f43-bc19-045f05524003 could not be found. {{(pid=61510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:47:21 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-fe854f5c-9920-4eb6-85d8-0871c75ebb1d tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003" status: 404 len: 111 microversion: 2.1 time: 0.029036 Apr 21 15:47:21 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 148/445] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:47:21 2023] GET /compute/v2.1/servers/0dec7df6-20c7-4f43-bc19-045f05524003 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:47:21 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-7fe7fb42-5230-471b-ac3a-8dcb333567ea tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:47:21 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-7fe7fb42-5230-471b-ac3a-8dcb333567ea tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 6aee29af-024c-4e5c-a893-87af63214df3] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:47:21 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7fe7fb42-5230-471b-ac3a-8dcb333567ea tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:47:21 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7fe7fb42-5230-471b-ac3a-8dcb333567ea tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:47:21 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7fe7fb42-5230-471b-ac3a-8dcb333567ea tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:47:21 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7fe7fb42-5230-471b-ac3a-8dcb333567ea tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:47:21 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7fe7fb42-5230-471b-ac3a-8dcb333567ea tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:47:21 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7fe7fb42-5230-471b-ac3a-8dcb333567ea tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:47:21 user devstack@n-api.service[61511]: INFO nova.api.openstack.wsgi [None req-7fe7fb42-5230-471b-ac3a-8dcb333567ea tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] HTTP exception thrown: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-7fe7fb42-5230-471b-ac3a-8dcb333567ea tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Request method failure captured: Apr 21 15:47:21 user devstack@n-api.service[61511]: request: DELETE /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3 HTTP/1.1 Apr 21 15:47:21 user devstack@n-api.service[61511]: Accept: application/json Apr 21 15:47:21 user devstack@n-api.service[61511]: Accept-Encoding: identity Apr 21 15:47:21 user devstack@n-api.service[61511]: Connection: close Apr 21 15:47:21 user devstack@n-api.service[61511]: Content-Length: 0 Apr 21 15:47:21 user devstack@n-api.service[61511]: Content-Type: application/json Apr 21 15:47:21 user devstack@n-api.service[61511]: Host: 10.0.0.210 Apr 21 15:47:21 user devstack@n-api.service[61511]: Openstack-System-Scope: None Apr 21 15:47:21 user devstack@n-api.service[61511]: User-Agent: python-urllib3/1.26.15 Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Auth-Token: gAAAAABkQq67k5OzpabRUhwBjROgQzW6ZMTMyqN6T_g_CRNnYwrsFhei_HcvXDYpZiwvlQft-GmQNM-WN65kgj_7hG2ePY9Kx9M_e5Ngdwl0eqsVVYUFgQUeOeJfOUurYcSThH5n9w2qnJqxMVJ4JZ6POwGlIrGMcA_dCxI4bk_vMokxbz0LDS4 Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Domain-Id: None Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Domain-Name: None Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Identity-Status: Confirmed Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Is-Admin-Project: True Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Project-Domain-Id: default Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Project-Domain-Name: Default Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Project-Id: c72ad1c36d144329b11fa1284f3bfd67 Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Project-Name: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Role: reader,member Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Roles: reader,member Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Tenant: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Tenant-Id: c72ad1c36d144329b11fa1284f3bfd67 Apr 21 15:47:21 user devstack@n-api.service[61511]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:21 user devstack@n-api.service[61511]: X-User: tempest-AttachVolumeTestJSON-1973553730-project-member Apr 21 15:47:21 user devstack@n-api.service[61511]: X-User-Domain-Id: default Apr 21 15:47:21 user devstack@n-api.service[61511]: X-User-Domain-Name: Default Apr 21 15:47:21 user devstack@n-api.service[61511]: X-User-Id: aecd98fdee134e4c82e721ee37b67553 Apr 21 15:47:21 user devstack@n-api.service[61511]: X-User-Name: tempest-AttachVolumeTestJSON-1973553730-project-member Apr 21 15:47:21 user devstack@n-api.service[61511]: method: > Apr 21 15:47:21 user devstack@n-api.service[61511]: exception: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61511]: action_args: {'id': '6aee29af-024c-4e5c-a893-87af63214df3'} Apr 21 15:47:21 user devstack@n-api.service[61511]: {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61511]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-7fe7fb42-5230-471b-ac3a-8dcb333567ea tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Returning 404 to user: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. {{(pid=61511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:47:21 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-7fe7fb42-5230-471b-ac3a-8dcb333567ea tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3" status: 404 len: 111 microversion: 2.1 time: 0.072506 Apr 21 15:47:21 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 151/446] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:47:21 2023] DELETE /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-91efd97e-561d-46d9-938e-27231993f92c tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-91efd97e-561d-46d9-938e-27231993f92c tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] [instance: 6aee29af-024c-4e5c-a893-87af63214df3] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-91efd97e-561d-46d9-938e-27231993f92c tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-91efd97e-561d-46d9-938e-27231993f92c tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-91efd97e-561d-46d9-938e-27231993f92c tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-91efd97e-561d-46d9-938e-27231993f92c tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-91efd97e-561d-46d9-938e-27231993f92c tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-91efd97e-561d-46d9-938e-27231993f92c tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:47:21 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-91efd97e-561d-46d9-938e-27231993f92c tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] HTTP exception thrown: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-91efd97e-561d-46d9-938e-27231993f92c tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Request method failure captured: Apr 21 15:47:21 user devstack@n-api.service[61512]: request: GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3 HTTP/1.1 Apr 21 15:47:21 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:47:21 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:47:21 user devstack@n-api.service[61512]: Connection: close Apr 21 15:47:21 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:47:21 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:47:21 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:47:21 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:47:21 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQq67k5OzpabRUhwBjROgQzW6ZMTMyqN6T_g_CRNnYwrsFhei_HcvXDYpZiwvlQft-GmQNM-WN65kgj_7hG2ePY9Kx9M_e5Ngdwl0eqsVVYUFgQUeOeJfOUurYcSThH5n9w2qnJqxMVJ4JZ6POwGlIrGMcA_dCxI4bk_vMokxbz0LDS4 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Project-Id: c72ad1c36d144329b11fa1284f3bfd67 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Project-Name: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c72ad1c36d144329b11fa1284f3bfd67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Tenant: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Tenant-Id: c72ad1c36d144329b11fa1284f3bfd67 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1973553730 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-User: tempest-AttachVolumeTestJSON-1973553730-project-member Apr 21 15:47:21 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:47:21 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:47:21 user devstack@n-api.service[61512]: X-User-Id: aecd98fdee134e4c82e721ee37b67553 Apr 21 15:47:21 user devstack@n-api.service[61512]: X-User-Name: tempest-AttachVolumeTestJSON-1973553730-project-member Apr 21 15:47:21 user devstack@n-api.service[61512]: method: > Apr 21 15:47:21 user devstack@n-api.service[61512]: exception: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61512]: action_args: {'id': '6aee29af-024c-4e5c-a893-87af63214df3'} Apr 21 15:47:21 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. Apr 21 15:47:21 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:47:21 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-91efd97e-561d-46d9-938e-27231993f92c tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] Returning 404 to user: Instance 6aee29af-024c-4e5c-a893-87af63214df3 could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:47:21 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-91efd97e-561d-46d9-938e-27231993f92c tempest-AttachVolumeTestJSON-1973553730 tempest-AttachVolumeTestJSON-1973553730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3" status: 404 len: 111 microversion: 2.1 time: 0.026994 Apr 21 15:47:21 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 148/447] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:47:21 2023] GET /compute/v2.1/servers/6aee29af-024c-4e5c-a893-87af63214df3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:47:23 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-b3e1393d-a36f-4381-8b11-a59d99df4fd3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:47:23 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-b3e1393d-a36f-4381-8b11-a59d99df4fd3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: e429c426-49b3-40ab-bb9c-a37e7496b04d] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:47:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b3e1393d-a36f-4381-8b11-a59d99df4fd3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:47:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b3e1393d-a36f-4381-8b11-a59d99df4fd3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:47:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b3e1393d-a36f-4381-8b11-a59d99df4fd3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:47:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b3e1393d-a36f-4381-8b11-a59d99df4fd3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:47:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b3e1393d-a36f-4381-8b11-a59d99df4fd3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:47:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-b3e1393d-a36f-4381-8b11-a59d99df4fd3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:47:23 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-b3e1393d-a36f-4381-8b11-a59d99df4fd3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87426e3ed6b24719a304a9fffd4521ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f94bc14394246d6b1276f163d904fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:47:23 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-b3e1393d-a36f-4381-8b11-a59d99df4fd3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d" status: 200 len: 1536 microversion: 2.1 time: 0.257317 Apr 21 15:47:23 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 149/448] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:47:23 2023] GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d => generated 1536 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:47:51 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:51 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell1:SELECT=2 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:52 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-0976c769-1939-4c28-9b73-0dcdd6579c71 tempest-TestShelveInstance-64712753 tempest-TestShelveInstance-64712753-project-member] Action: 'create', calling method: .version_select at 0x7f0c14536710>, body: {"keypair": {"name": "tempest-TestShelveInstance-1909805497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQHel3X9+RJUp6fKjFt166QQS7/KCUMt2LMTS8X0JF/IMNaKaFfNlRihUkcI/BPL4sjXmv/szWPr7NPBxlxLGz/7JL6Nw5cO4S0bv5Zk9kDPgaaoNb7lVdTKP/gyo6/Ug=="}} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:47:52 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-0976c769-1939-4c28-9b73-0dcdd6579c71 tempest-TestShelveInstance-64712753 tempest-TestShelveInstance-64712753-project-member] Getting quotas for project 72a9f24b272041c2989219ca448e3510. Resources: {'key_pairs'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 21 15:47:52 user devstack@n-api.service[61511]: DEBUG nova.quota [None req-0976c769-1939-4c28-9b73-0dcdd6579c71 tempest-TestShelveInstance-64712753 tempest-TestShelveInstance-64712753-project-member] Getting quotas for user 7598529052cd44d3a6dfff63a3162141 and project 72a9f24b272041c2989219ca448e3510. Resources: {'key_pairs'} {{(pid=61511) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 21 15:47:52 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-0976c769-1939-4c28-9b73-0dcdd6579c71 tempest-TestShelveInstance-64712753 tempest-TestShelveInstance-64712753-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.351104 Apr 21 15:47:52 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 152/449] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 21 15:47:51 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:47:55 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-950fbfd0-77b6-43a0-9278-43c316b34329 tempest-TestShelveInstance-64712753 tempest-TestShelveInstance-64712753-project-member] Calling method '.version_select at 0x7f0c146b4a60>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:47:55 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:55 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:47:55 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-950fbfd0-77b6-43a0-9278-43c316b34329 tempest-TestShelveInstance-64712753 tempest-TestShelveInstance-64712753-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1909805497" status: 202 len: 0 microversion: 2.1 time: 0.032679 Apr 21 15:47:55 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 149/450] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 21 15:47:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1909805497 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 21 15:48:23 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=6 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:48:23 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=10 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:48:23 user devstack@n-api.service[61510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 21 15:48:23 user devstack@n-api.service[61510]: Fri Apr 21 15:48:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d (ip 10.0.0.210) !!! Apr 21 15:48:23 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-d85ec69b-f7e8-4f7b-864d-c714080b6563 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:48:23 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-d85ec69b-f7e8-4f7b-864d-c714080b6563 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: e429c426-49b3-40ab-bb9c-a37e7496b04d] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:48:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d85ec69b-f7e8-4f7b-864d-c714080b6563 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d85ec69b-f7e8-4f7b-864d-c714080b6563 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d85ec69b-f7e8-4f7b-864d-c714080b6563 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d85ec69b-f7e8-4f7b-864d-c714080b6563 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d85ec69b-f7e8-4f7b-864d-c714080b6563 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:23 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-d85ec69b-f7e8-4f7b-864d-c714080b6563 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:23 user devstack@n-api.service[61510]: DEBUG nova.policy [None req-d85ec69b-f7e8-4f7b-864d-c714080b6563 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87426e3ed6b24719a304a9fffd4521ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f94bc14394246d6b1276f163d904fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61510) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:48:23 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-d85ec69b-f7e8-4f7b-864d-c714080b6563 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d" status: 200 len: 1536 microversion: 2.1 time: 0.221509 Apr 21 15:48:23 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 150/451] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:48:23 2023] GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d => generated 1536 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:48:23 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_cell0:SELECT=4 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:48:23 user devstack@n-api.service[61511]: DEBUG dbcounter [-] [61511] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61511) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:48:23 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-85321b3e-3bd1-4651-bff6-aede0036d176 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:48:23 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-85321b3e-3bd1-4651-bff6-aede0036d176 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '87426e3ed6b24719a304a9fffd4521ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f94bc14394246d6b1276f163d904fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:48:23 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-85321b3e-3bd1-4651-bff6-aede0036d176 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Searching by: {'deleted': False, 'project_id': '4f94bc14394246d6b1276f163d904fcb'} {{(pid=61511) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 21 15:48:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-85321b3e-3bd1-4651-bff6-aede0036d176 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-85321b3e-3bd1-4651-bff6-aede0036d176 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-85321b3e-3bd1-4651-bff6-aede0036d176 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-85321b3e-3bd1-4651-bff6-aede0036d176 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-85321b3e-3bd1-4651-bff6-aede0036d176 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:23 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-85321b3e-3bd1-4651-bff6-aede0036d176 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:23 user devstack@n-api.service[61511]: DEBUG nova.compute.multi_cell_list [None req-85321b3e-3bd1-4651-bff6-aede0036d176 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 21 15:48:23 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-85321b3e-3bd1-4651-bff6-aede0036d176 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.203217 Apr 21 15:48:23 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 153/452] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 21 15:48:23 2023] GET /compute/v2.1/servers => generated 340 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:48:23 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:48:23 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-1e7065ad-577c-4104-92ea-b526a3ace1db tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:48:23 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-1e7065ad-577c-4104-92ea-b526a3ace1db tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: e429c426-49b3-40ab-bb9c-a37e7496b04d] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:48:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1e7065ad-577c-4104-92ea-b526a3ace1db tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1e7065ad-577c-4104-92ea-b526a3ace1db tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1e7065ad-577c-4104-92ea-b526a3ace1db tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1e7065ad-577c-4104-92ea-b526a3ace1db tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1e7065ad-577c-4104-92ea-b526a3ace1db tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:23 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-1e7065ad-577c-4104-92ea-b526a3ace1db tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:24 user devstack@n-api.service[61512]: DEBUG nova.policy [None req-1e7065ad-577c-4104-92ea-b526a3ace1db tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87426e3ed6b24719a304a9fffd4521ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f94bc14394246d6b1276f163d904fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61512) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:48:24 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-1e7065ad-577c-4104-92ea-b526a3ace1db tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d" status: 200 len: 1536 microversion: 2.1 time: 0.387836 Apr 21 15:48:24 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 150/453] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:48:23 2023] GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d => generated 1536 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:48:25 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-e3d00446-553c-4291-a4f6-3691597e5f3a tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:48:25 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-e3d00446-553c-4291-a4f6-3691597e5f3a tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: e429c426-49b3-40ab-bb9c-a37e7496b04d] Fetching instance by UUID {{(pid=61510) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:48:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e3d00446-553c-4291-a4f6-3691597e5f3a tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e3d00446-553c-4291-a4f6-3691597e5f3a tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e3d00446-553c-4291-a4f6-3691597e5f3a tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e3d00446-553c-4291-a4f6-3691597e5f3a tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e3d00446-553c-4291-a4f6-3691597e5f3a tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:25 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [None req-e3d00446-553c-4291-a4f6-3691597e5f3a tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:25 user devstack@n-api.service[61510]: DEBUG nova.compute.api [None req-e3d00446-553c-4291-a4f6-3691597e5f3a tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: e429c426-49b3-40ab-bb9c-a37e7496b04d] Going to try to terminate instance {{(pid=61510) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 21 15:48:25 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-e3d00446-553c-4291-a4f6-3691597e5f3a tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d" status: 204 len: 0 microversion: 2.1 time: 0.105111 Apr 21 15:48:25 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 151/454] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 21 15:48:25 2023] DELETE /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 21 15:48:25 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [None req-7d64f679-0c0b-43a5-b336-7d589d26ceb3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:48:25 user devstack@n-api.service[61511]: DEBUG nova.compute.api [None req-7d64f679-0c0b-43a5-b336-7d589d26ceb3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: e429c426-49b3-40ab-bb9c-a37e7496b04d] Fetching instance by UUID {{(pid=61511) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:48:25 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7d64f679-0c0b-43a5-b336-7d589d26ceb3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:25 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7d64f679-0c0b-43a5-b336-7d589d26ceb3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:25 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7d64f679-0c0b-43a5-b336-7d589d26ceb3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:25 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7d64f679-0c0b-43a5-b336-7d589d26ceb3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:25 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7d64f679-0c0b-43a5-b336-7d589d26ceb3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:25 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [None req-7d64f679-0c0b-43a5-b336-7d589d26ceb3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:26 user devstack@n-api.service[61511]: DEBUG nova.policy [None req-7d64f679-0c0b-43a5-b336-7d589d26ceb3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87426e3ed6b24719a304a9fffd4521ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f94bc14394246d6b1276f163d904fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61511) authorize /opt/stack/nova/nova/policy.py:203}} Apr 21 15:48:26 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [req-30fe2fcc-8a5e-4a35-9259-48293fd7841b req-312f4727-c505-43b7-b723-075d470982a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e429c426-49b3-40ab-bb9c-a37e7496b04d", "name": "network-vif-unplugged", "status": "completed", "tag": "3e80791d-05df-4a2f-82f7-d2ee2c5a15ad"}]} {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:48:26 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [None req-7d64f679-0c0b-43a5-b336-7d589d26ceb3 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d" status: 200 len: 1542 microversion: 2.1 time: 0.309077 Apr 21 15:48:26 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 154/455] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:48:25 2023] GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d => generated 1542 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 21 15:48:26 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-30fe2fcc-8a5e-4a35-9259-48293fd7841b req-312f4727-c505-43b7-b723-075d470982a7 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:26 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-30fe2fcc-8a5e-4a35-9259-48293fd7841b req-312f4727-c505-43b7-b723-075d470982a7 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:26 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [req-30fe2fcc-8a5e-4a35-9259-48293fd7841b req-312f4727-c505-43b7-b723-075d470982a7 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:26 user devstack@n-api.service[61512]: INFO nova.api.openstack.compute.server_external_events [req-30fe2fcc-8a5e-4a35-9259-48293fd7841b req-312f4727-c505-43b7-b723-075d470982a7 service nova] Creating event network-vif-unplugged:3e80791d-05df-4a2f-82f7-d2ee2c5a15ad for instance e429c426-49b3-40ab-bb9c-a37e7496b04d on user Apr 21 15:48:26 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [req-30fe2fcc-8a5e-4a35-9259-48293fd7841b req-312f4727-c505-43b7-b723-075d470982a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031651 Apr 21 15:48:26 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 151/456] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:48:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:48:26 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [req-c486ff6d-1615-4475-8811-f6dcb0c7836e req-e1d98d78-284a-4f09-93ed-f154b6ce1413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e429c426-49b3-40ab-bb9c-a37e7496b04d", "name": "network-vif-deleted", "tag": "3e80791d-05df-4a2f-82f7-d2ee2c5a15ad"}]} {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:48:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-c486ff6d-1615-4475-8811-f6dcb0c7836e req-e1d98d78-284a-4f09-93ed-f154b6ce1413 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-c486ff6d-1615-4475-8811-f6dcb0c7836e req-e1d98d78-284a-4f09-93ed-f154b6ce1413 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:26 user devstack@n-api.service[61510]: DEBUG oslo_concurrency.lockutils [req-c486ff6d-1615-4475-8811-f6dcb0c7836e req-e1d98d78-284a-4f09-93ed-f154b6ce1413 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61510) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:26 user devstack@n-api.service[61510]: INFO nova.api.openstack.compute.server_external_events [req-c486ff6d-1615-4475-8811-f6dcb0c7836e req-e1d98d78-284a-4f09-93ed-f154b6ce1413 service nova] Creating event network-vif-deleted:3e80791d-05df-4a2f-82f7-d2ee2c5a15ad for instance e429c426-49b3-40ab-bb9c-a37e7496b04d on user Apr 21 15:48:26 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [req-c486ff6d-1615-4475-8811-f6dcb0c7836e req-e1d98d78-284a-4f09-93ed-f154b6ce1413 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086321 Apr 21 15:48:27 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 152/457] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:48:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:48:28 user devstack@n-api.service[61511]: DEBUG nova.api.openstack.wsgi [req-9cf58d87-5dbd-4daa-8e82-41581397fd0d req-573507a2-7bda-4a06-945d-a0dd083168f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e429c426-49b3-40ab-bb9c-a37e7496b04d", "name": "network-vif-plugged", "status": "completed", "tag": "3e80791d-05df-4a2f-82f7-d2ee2c5a15ad"}]} {{(pid=61511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 21 15:48:28 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-9cf58d87-5dbd-4daa-8e82-41581397fd0d req-573507a2-7bda-4a06-945d-a0dd083168f2 service nova] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:48:28 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-9cf58d87-5dbd-4daa-8e82-41581397fd0d req-573507a2-7bda-4a06-945d-a0dd083168f2 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:48:28 user devstack@n-api.service[61511]: DEBUG oslo_concurrency.lockutils [req-9cf58d87-5dbd-4daa-8e82-41581397fd0d req-573507a2-7bda-4a06-945d-a0dd083168f2 service nova] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61511) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:48:28 user devstack@n-api.service[61511]: INFO nova.api.openstack.compute.server_external_events [req-9cf58d87-5dbd-4daa-8e82-41581397fd0d req-573507a2-7bda-4a06-945d-a0dd083168f2 service nova] Creating event network-vif-plugged:3e80791d-05df-4a2f-82f7-d2ee2c5a15ad for instance e429c426-49b3-40ab-bb9c-a37e7496b04d on user Apr 21 15:48:28 user devstack@n-api.service[61511]: INFO nova.api.openstack.requestlog [req-9cf58d87-5dbd-4daa-8e82-41581397fd0d req-573507a2-7bda-4a06-945d-a0dd083168f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030181 Apr 21 15:48:28 user devstack@n-api.service[61511]: [pid: 61511|app: 0|req: 155/458] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 21 15:48:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 21 15:49:16 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_api:SELECT=4 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:49:16 user devstack@n-api.service[61512]: DEBUG dbcounter [-] [61512] Writing DB stats nova_cell1:SELECT=8 {{(pid=61512) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:49:16 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-40fa9a07-7231-4f1f-a477-5e7919135a26 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '>' {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:49:16 user devstack@n-api.service[61512]: DEBUG nova.compute.api [None req-40fa9a07-7231-4f1f-a477-5e7919135a26 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] [instance: e429c426-49b3-40ab-bb9c-a37e7496b04d] Fetching instance by UUID {{(pid=61512) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 21 15:49:16 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-40fa9a07-7231-4f1f-a477-5e7919135a26 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:49:16 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-40fa9a07-7231-4f1f-a477-5e7919135a26 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:49:16 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-40fa9a07-7231-4f1f-a477-5e7919135a26 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:49:16 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-40fa9a07-7231-4f1f-a477-5e7919135a26 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Acquiring lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 21 15:49:16 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-40fa9a07-7231-4f1f-a477-5e7919135a26 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 21 15:49:16 user devstack@n-api.service[61512]: DEBUG oslo_concurrency.lockutils [None req-40fa9a07-7231-4f1f-a477-5e7919135a26 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Lock "ec9e962f-7b82-4673-844a-78caa9c9d46e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61512) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 21 15:49:16 user devstack@n-api.service[61512]: INFO nova.api.openstack.wsgi [None req-40fa9a07-7231-4f1f-a477-5e7919135a26 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] HTTP exception thrown: Instance e429c426-49b3-40ab-bb9c-a37e7496b04d could not be found. Apr 21 15:49:16 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-40fa9a07-7231-4f1f-a477-5e7919135a26 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Request method failure captured: Apr 21 15:49:16 user devstack@n-api.service[61512]: request: GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d HTTP/1.1 Apr 21 15:49:16 user devstack@n-api.service[61512]: Accept: application/json Apr 21 15:49:16 user devstack@n-api.service[61512]: Accept-Encoding: identity Apr 21 15:49:16 user devstack@n-api.service[61512]: Connection: close Apr 21 15:49:16 user devstack@n-api.service[61512]: Content-Length: 0 Apr 21 15:49:16 user devstack@n-api.service[61512]: Content-Type: application/json Apr 21 15:49:16 user devstack@n-api.service[61512]: Host: 10.0.0.210 Apr 21 15:49:16 user devstack@n-api.service[61512]: Openstack-System-Scope: None Apr 21 15:49:16 user devstack@n-api.service[61512]: User-Agent: python-urllib3/1.26.15 Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Auth-Token: gAAAAABkQq8oao_QCz0lLayBPZdk0jYWlv6ftz5j2nymu7swmbjbQj2LDLUvKaw54am1pjFELEKNymXcfMlMv5MuKaCPn7hnnCanm2JFOuoVKOWm3nul_no_urpP7HMUB6WneertGymZ6_EGyseqxjhhdf2-nhCmO52_ZLsXfVDk1wJQFawffPQ Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Domain-Id: None Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Domain-Name: None Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Identity-Status: Confirmed Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Is-Admin-Project: True Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Project-Domain-Id: default Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Project-Domain-Name: Default Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Project-Id: 4f94bc14394246d6b1276f163d904fcb Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Project-Name: tempest-TestMinimumBasicScenario-1717654390 Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Role: reader,member Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Roles: reader,member Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f94bc14394246d6b1276f163d904fcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f94bc14394246d6b1276f163d904fcb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f94bc14394246d6b1276f163d904fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Tenant: tempest-TestMinimumBasicScenario-1717654390 Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Tenant-Id: 4f94bc14394246d6b1276f163d904fcb Apr 21 15:49:16 user devstack@n-api.service[61512]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1717654390 Apr 21 15:49:16 user devstack@n-api.service[61512]: X-User: tempest-TestMinimumBasicScenario-1717654390-project-member Apr 21 15:49:16 user devstack@n-api.service[61512]: X-User-Domain-Id: default Apr 21 15:49:16 user devstack@n-api.service[61512]: X-User-Domain-Name: Default Apr 21 15:49:16 user devstack@n-api.service[61512]: X-User-Id: 87426e3ed6b24719a304a9fffd4521ae Apr 21 15:49:16 user devstack@n-api.service[61512]: X-User-Name: tempest-TestMinimumBasicScenario-1717654390-project-member Apr 21 15:49:16 user devstack@n-api.service[61512]: method: > Apr 21 15:49:16 user devstack@n-api.service[61512]: exception: Instance e429c426-49b3-40ab-bb9c-a37e7496b04d could not be found. Apr 21 15:49:16 user devstack@n-api.service[61512]: action_args: {'id': 'e429c426-49b3-40ab-bb9c-a37e7496b04d'} Apr 21 15:49:16 user devstack@n-api.service[61512]: {{(pid=61512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e429c426-49b3-40ab-bb9c-a37e7496b04d could not be found. Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e429c426-49b3-40ab-bb9c-a37e7496b04d could not be found. Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e429c426-49b3-40ab-bb9c-a37e7496b04d could not be found. Apr 21 15:49:16 user devstack@n-api.service[61512]: ERROR nova.api.openstack.wsgi Apr 21 15:49:16 user devstack@n-api.service[61512]: DEBUG nova.api.openstack.wsgi [None req-40fa9a07-7231-4f1f-a477-5e7919135a26 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Returning 404 to user: Instance e429c426-49b3-40ab-bb9c-a37e7496b04d could not be found. {{(pid=61512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 21 15:49:16 user devstack@n-api.service[61512]: INFO nova.api.openstack.requestlog [None req-40fa9a07-7231-4f1f-a477-5e7919135a26 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d" status: 404 len: 111 microversion: 2.1 time: 0.144667 Apr 21 15:49:16 user devstack@n-api.service[61512]: [pid: 61512|app: 0|req: 152/459] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 21 15:49:16 2023] GET /compute/v2.1/servers/e429c426-49b3-40ab-bb9c-a37e7496b04d => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 21 15:49:16 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:49:16 user devstack@n-api.service[61510]: DEBUG dbcounter [-] [61510] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61510) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 21 15:49:16 user devstack@n-api.service[61510]: DEBUG nova.api.openstack.wsgi [None req-2baf3894-5e09-472b-9057-a715e6295e65 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] Calling method '.version_select at 0x7f0c146c4d30>' {{(pid=61510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 21 15:49:16 user devstack@n-api.service[61510]: INFO nova.api.openstack.requestlog [None req-2baf3894-5e09-472b-9057-a715e6295e65 tempest-TestMinimumBasicScenario-1717654390 tempest-TestMinimumBasicScenario-1717654390-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-652457593" status: 202 len: 0 microversion: 2.1 time: 0.041918 Apr 21 15:49:16 user devstack@n-api.service[61510]: [pid: 61510|app: 0|req: 153/460] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 21 15:49:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-652457593 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)